In 1941, Carlebach's family was deported along with the entire Jewish community of Hamburg to the Jungfernhof concentration camp near Riga in Latvia. Carlebach's parents and his sisters Ruth, Noemi and Sara were killed in a forest near Riga in 1942. As the youngest son, Carlebach was able to survive the Holocaust while suffering four years of internment in nine different concentration camps. His older four sisters and brother were sent to England by their parents and survived the war; his sister Miriam made aliyah instead. Carlebach talked with the authors of the book Die Carlebachs, eine Rabbinerfamilie aus Deutschland about his father and the time in the concentration camps. Some of these details appear in, the German article about the camp.
After the war, Carlebach was accepted as a student at the Yeshiva Rabbi Chaim Berlin, where he became one of the closest disciples of its rosh yeshiva Yitzchok Hutner. So much so, that Carlebach was selected to write the brief welcoming introductions in Hutner's works, the Pachad Yitzchok, where he would sign himself as שלמה בן הרב ר' יוסף צבי הי"ד קרליבך . Carlebach was serving as a high school teacher of Torah studies and Talmud in the Yeshiva of Eastern Parkway in Brooklyn, when Hutner appointed him the new mashgiach ruchani of Chaim Berlin following the departure of Avigdor Miller, who had been long tenured in that position. He served as mashgiach of the yeshiva and Kollel Gur Aryeh from 1966 to 1978, after which he was succeeded by Shimon Groner, one of Hutner's trusted disciples. For the most part, Carlebach was a very successful mashgiach. He began to develop a series of lectures that he eventually published, first in pamphlet form and later in a full series that he would call Maskil Lishlomo.
Final years at Chaim Berlin
Hutner had always wanted to move to Israel to establish a new yeshiva. He made aliyah together with his only daughter, Bruria David, who was childless, leaving Yeshiva Rabbi Chaim Berlin and Kollel Gur Aryeh to his disciples. While the designated new rosh yeshiva was to be Aaron Schechter, it was assumed that Carlebach would continue as mashgiach. However, in 1977, a serious dispute arose between Carlebach and Hutner and his disciples. The result of this power struggle was Carlebach being denied access to the yeshiva, though he subsequently refused to relinquish the title mashgiach ruchani. Carlebach attempted to bring the termination of his employment and the manner in which it was done to adjudication with various batei din. Hutner maintained that in this instance, he was not subject to such proceedings. That pronouncement has been adopted by his designated heirs, who took complete control of the yeshiva following Hutner's death in 1980.
Author and lecturer
Following his departure from Chaim Berlin, Carlebach delivered lectures at various Beis Yaakov schools and seminaries for young women. His eloquent speaking style garnered him a wide audience, and he began to record and sell tapes of his lectures. But the bulk of his time and energy were reserved for writing his life's work inHebrew, which was to become the five volumed Maskil Lishlomo on the Chumash that incorporated much of Hutner's thought system in his ten volume Pachad Yitzchok. In recent years, Carlebach has dedicated much of his time to writing a biography of his father, Ish Yehudi – The Life and Legacy of a Torah Great: Joseph Tzvi Carlebach. He is also working on translating his father's writings into English.