The parish began in 1791 as Saint Patrick Church founded by French Catholics fleeing the French Revolution who were joined by some of the earliest Irish Catholic immigrants to the United States. St. Patrick's was the oldest parish in the Richmond Diocese and predated the formation of the diocese by 29 years.
19th century
The first church edifice was built in 1842, but was destroyed by fire in 1856. The present building was completed in 1858 and was rededicated under the title of the Blessed Virgin Mary of the Immaculate Conception in commemoration of the Marian dogma proclaimed in 1854 by Pope Pius IX. Since it was in the Southern United States, the racially segregatedChristian church was for whites only. Fr. Matthew O’Keefe initiated permitting African American Catholics to sit in an assigned portion of the choir loft for their use only. Local Know Nothing movement anti-Catholics threatened him unless the church instituted segregated Masses, which he refused. Thugs tried to intimidate white parishioners until Fr. O’Keefe obtained police protection. Diocesan records show that local Catholic families believed the Know Nothings ignited the fire that destroyed St. Patrick's in 1856. "The Assumption," a painting donated by King Louis Philippe and Queen Amélie of France, fell victim to the flames. The Josephite Fathers arrived in Norfolk from Richmond in 1889. By September of that year, the separate Saint Joseph's Black Catholic parish was founded to serve the religious needs of the city's African American community. When Fr. Matthew O'Keefe moved north to Maryland, he would modeled his new church after St. Mary's. Completed in 1906, Church of the Immaculate Conception in Towson shares the blueprints of St. Mary's with the exceptions of a larger rose window rather than a spire, thicker interior columns, and brownstone accents to the buttress and windows. Father O'Keefe, the first pastor of the new St. Mary's and Immaculate Conception, is buried beneath the altar of the latter.
20th century
In 1961, seventy-two years after its founding, Saint Joseph's Black Catholic parish was clustered with Saint Mary of the Immaculate Conception. After an extensive renovation and restoration program, the newly renovated and restored edifice was rededicated on November 1, 1989. Today, St. Mary's Catholic Church is ninety-nine percent African American congregants. The parish formerly supported St. Mary Academy, an inner-city school that provided a Christian education to hundreds of urban children, most of whom were non-Catholic; however, circumstances forced the academy to close. The parish also operates a soup kitchen and provides other outreach to Norfolk's poor and homeless. ;Minor basilica On the occasion of the 200th anniversary of the church, December 8, 1991, Pope John Paul II proclaimed the Church of Saint Mary of the Immaculate Conception a minor basilica, the only one in the Commonwealth of Virginia and the only one with predominantly African-American parishioners.