On Harper's return to Australia from Edinburgh, he was assistant at Chalmers' Church, East Melbourne from September 1873–1875. He did not pursue the ministry at this point as his doctrinal views were liberal evangelical and were not openly accepted at that time. He was appointed English master at the Presbyterian Ladies' College, Melbourne, in 1875, becoming headmaster in 1877, and in 1879, Principal. Harper resigned at the end of 1888, leaving the school with a high reputation among the secondary schools of Victoria. Also in 1888, Harper was appointed lecturer of Hebrew and Old TestamentExegesis at Ormond College within the University of Melbourne. He was ordained and appointed Professor in 1893. He was editor of The Messenger of the Presbyterian Church of Victoria in 1895–1902, and carried it on with much ability. In 1902 he took up the appointment as Hunter-Baillie professor of Hebrew and Principal of St Andrew's College at the University of Sydney, and was Chairman of the Presbyterian Ladies' College, Sydney Council from 1907 until 1913.
Retirement and death
Harper was a good speaker and debater who exercised much influence in the Presbyterian Church of Australia, and more especially on the candidates for the ministry who studied under him. He had decided convictions but could realise the difficulties of others. Personally he was modest and thoroughly sincere, loyal to the Christian faith yet believing in scientific inquiry, a wise and understanding mentor at a period of transition and reshaping, when many beliefs once firmly held were being attacked. Harper resigned the office of Principal of St Andrew's College in 1921, and the professorship in May 1924, being then in his eightieth year. He retired to Edinburgh where he died on 25 November 1936, twelve days after his 92nd birthday. He is buried in the 20th century extension to Dean Cemetery accessed off Queensferry Road in western Edinburgh. His wife Barbara lies with him along with two daughters: Elizabeth Beatrice Harper and Agnes Ethel Harper.
Family
Harper married twice: firstly to Agnes Marion Craig on 23 October 1875 and secondly to Barbara Harriet Rainy, daughter of Dr Robert Rainy, Principal of New College, Edinburgh, where Harper had studied for his divinity degree. She survived him with two sons and five daughters. His and Barbara's daughter Margaret Hilda Harper became a noted physician.
Publications
Harper was a fine scholar but did not publish a great deal. The Book of Deuteronomy in the Expositer's Bible series, published in 1895, gave him a good reputation, as it was widely recognised as a work of great value. He also contributed a volume, The Song of Solomon to The Cambridge Bible for Schools and Colleges in 1902. His The Hon. James Balfour M.L.C., a Memoir, is an interesting record of a leading Melbourne merchant and politician whom Harper had known for nearly 50 years. A series of lectures to the Sydney University Christian Union was published under the title Christian Essentials; he printed a few pamphlets, and he also contributed the chapter on "The White Australia Policy" to Australia, Economic and Political Studies, edited by Meredith Atkinson and published in 1920.