Quinn was ordained a priest in Rome on the Feast of the Assumption, 15 August 1843. His first assignment was to run an academy in Dublin. His good work impressed his superiors, particularly Cardinal Paul Cullen. In June 1859 when the Diocese of Brisbane was created, Quinn was appointed the first bishop. He was consecrated in Dublin on 29 June 1859, but did not arrive in Queensland until 1861. On arrival in Brisbane, the new diocese had four churches, four schools and a debt of £1250. Quinn was very active in trying to grow the Roman Catholic presence, leading to the joke that the colony should not be called Queensland but Quinn's Land. Despite such remarks, he was respected by both Catholics and Protestants alike. When a prominent Orangeman Rev Porteus gave a speech in Ipswich that angered the Irish Catholics, a riot was feared at a picnic to be held by the Orangemen the following day. Quinn travelled to Ipswich and used his influence with Catholics to calm them and then he attended the picnic to spread goodwill among the Protestants. In 1875, the Irish celebrated the centenary of the birth of Irish nationalist Daniel O'Connell. As part of these celebrations, Quinn announced he was adding an "O" to his surname and would be henceforth known as O'Quinn. He tried to obtain government support for Catholic schools and clashed with Mother Mary MacKillop. His brother, Matthew Quinn, became the Roman Catholic Bishop of Bathurst in New South Wales. Four sons of their sister Sarah also became priests: Matthew, Andrew, James and Joseph Horan.
Later life
O'Quinn suffered ill health late in life. On 16 August 1881, he was pronounced gravely ill and last rites were administered. He died in his home Dara in Fortitude Valley on 18 August 1881 aged 62, having done a good deal to moderate the acerbity of Irish factional feeling during his episcopate. At 4pm on the day of his death, a procession formed at Dara to convey his body to the Cathedral of St Stephen. Although the intention had been for the coffin to be carried by a hearse, several gentlemen volunteered to carry it on their shoulders. The procession was led by the clergy, followed by the coffin and its pallbearers, the Sisters of Mercy, the children from Catholic schools, and then the public. O'Quinn's body was robed and lay in state in front of the high altar, where hundreds of people came to the church to pay their respects. The litany for the dead was conducted throughout the night. On 8am the following day, there was a requiem mass followed at 9am by a pontifical high mass conducted by his brother Matthew Quinn and assisted by his four Horan nephews. After the mass, people continued to file past the coffin for many hours. Many people travelled from Ipswich and Toowoomba to pay their respects. A group of Warwick citizens chartered a train to enable them to attend. At approximately 5pm, a funeral procession was formed and left the cathedral, proceeding along Elizabeth Street, Creek Street, Adelaide Street and George Street before returning to the cathedral. Those of other faiths honoured O'Quinn with Rabbi Phillips being part of the funeral procession while the great bell of St Johns Anglican Cathedral tolled throughout the procession to demonstrate the respect of the Anglican community. When the procession returned to St Stephens, O'Quinn's coffin was lowered into the vault prepared by architect Andrea Stombuco and covered with a marble slab. O'Quinn bequeathed everything he had to the Diocese of Brisbane.