Joyce was ordained priest on 31 October 1930 in the Cathedral of the Blessed Sacrament, Christchurch by his uncle James Byrne, the 1st Catholic Bishop of Toowoomba. He then spent three years in Auckland and was the chaplain at Sacred Heart College, then located in Ponsonby. Joyce returned to Christchurch in 1934 to be assistant priest at Addington and then at Riccarton. In 1937 he was loaned to the Diocese of Toowoomba where he assisted his uncle James Byrne until he died on 11 February 1938. In 1941 Joyce was appointed chaplain to the New Zealand Military Forces and served with New Zealand troops in Tonga and Fiji. In Fiji he was attached to the headquarters of the Fiji Infantry Brigade Group and was associated with many activities for the promotion of the welfare of the troops in his area. After his demobilisation in 1945, Joyce was posted to the reserve of officers with the rank of Major He was stationed at the Cathedral in Christchurch and engaged in rehabilitation work for returned soldiers. He represented Bishop Lyons for three years on the Labour Department immigration committee. At the same time he was involved with general Catholic activities being spiritual adviser to the Catholic Women's League and the Catholic Men's Luncheon Club. Joyce was very involved during the Ballantyne's fire tragedy of 1947 and represented Bishop Lyons at the mass funeral for the victims. Joyce became parish priest at Sockburn in 1947.
Episcopacy
Joyce was appointed Bishop of Christchurch on 18 April 1950 and was consecrated in the Cathedral on 16 July 1950 by Archbishop McKeefry and Bishops Liston and Kavanagh. Joyce's appointment was unusual among New Zealand bishops at that time in that he had no training in Rome or elsewhere overseas. During the 14 years of Joyce's episcopate the Christchurch diocese experienced considerable growth. The Catholic population increased from 31,769 to 48,500, the number of parishes increased from 32 to 47, the number of secular priests rose from 47 to 80, primary schools went from 35 to 53 and the number of pupils attending Catholic schools rose from 6524 to 11,038. Bishop Joyce opened two new secondary schools, Cottesmore College and St Thomas of Canterbury College. Among the other religious orders introduced by Joyce were the Brothers of St John of God and the Daughters of Our Lady of Compassion. Joyce founded the Mary Potter Hospice for the Dying, Rochester Hall and he encouraged the setting up of an outpatients psychiatric clinic at Calvary Hospital. He attended the first two sessions of the Second Vatican Council.