He was born to Samuel and Maria Goldstein in Kecskemét, Hungary. His father was chorister with Dovidl Brod Strelisker at Pest and later cantor at Kecskemét and then at Neutra, Hungary. Upon his father's death in about 1848, Josef, aged about 12, was so well acquainted with the liturgy and possessed such an exceptional tenor voice that the congregation of Neutra elected him as his father's successor. He remained there for two years and then undertook a four year tour through Austria and Germany, officiating in some of their largest congregations. Upon his return to Hungary, an admirer of his voice sent him to Vienna to be educated for the operatic stage. He received this training from Salvatore Marchesi, husband of the voice teacherMathilde Marchesi. On the completion of his training and while en route to his first engagement in Italy, he decided to return to the position of cantor and received an appointment at the newly built Leopoldstädter Tempel in Vienna in 1857. His published works include the three volume "Schire Jeschurun, Gesänge der Israeliten;" a collection of songs for the Sabbath and festivals, "Psalmen und Choralgesänge;" psalms and choral songs, and "Requiem für Cantor-Solo und gemischtem Chor mit Orgel-oder harmonium-Begleitung".
Family
He had six children with his wife Katharina ; Pauline, Sidonie, Bertha, twins Arnold and Emil Golz, and Irma Golz. Pauline, Bertha and Arnold all perished at the Theresienstadt concentration camp. Arnold and Emil Golz wrote libretti for operettas and burlesques performed on the Viennese stage. These included Die Gaukler, Die Königin der Nacht, Die Unsterbliche Familie, Die Schöne Ehebrecherin, Die Meerjungfrau, Baron Menelaus, Mamselle Napoleon, Die Fromme Helene Epsteins Witwe, Der Ledige Schwiegersohn, Frau Pick in Audienz, Der Autowildling, Hulda Pessl in Venedig, Villa Adelheid, Die Königin-Mutter, Der Jolly Joker, Die Expresshochzeit, Der Held ihrer Träum, Der Unwiderstehliche Kassian, Baronin Fritzi, Wo die Liebe Blüht, and Der Geldbriefträger. Irma Golz was a Viennese soprano who gained notoriety as an opera singer until her untimely death at the age of 30 to leukemia. Josef's brother Moritz Goldstein was cantor at the K. K. Bene Israel Synagogue in Cincinnati, Ohio from 1881 until his death. Morris composed and compiled music for use in American synagogues. In collaboration with Alois Kaiser, Samuel Welsh and I. L. Rice he published "Zimrath Yah: Liturgic songs consisting of Hebrew, English and German psalms and hymns systematically arranged for the Jewish rite with organ accompaniment". He also published "Kol Zimroh: A hymn book for temples and Sabbath schools and adapted for choirs and congregational singing" and "The Temple Service: Containing all the music required for the Union Prayer Book for Jewish worship". Morris was a maternal great-grandfather of conductor James Levine.