Thieben is a native of Suffolk County, New York, and attended Sayville High School from 1948 to 1952. On February 26, 1952, he scored a school record 48 points in a game against Northport. Sayville won the contest, 85–66. He decided to stay close to home when he went to college and enrolled at nearby Hofstra University. Due to NCAA rules at the time, freshmen were not allowed to play varsity sports. Thieben, therefore, had to play for the school's freshman team. Hofstra was classified as a Division II institution when he first entered college, but Thieben went on to have one of the greatest all-around basketball careers in NCAA history, regardless of classification. In 1953–54, his sophomore year, he became eligible to play. Standing at tall and weighing 215 pounds, Thieben is considered the first "big man" in Hofstra basketball history. He played in 24 games that season and averaged 24.6 points and 25.8 rebounds per game. That rebounding average is the 11th-highest in Division II history. In Thieben's junior season, he went on to average a career high 29.2 points and 24.4 rebounds in 26 games played. Look magazine named him an All-American at the end of the season. Thieben continued his 20–20 average during his senior season in 1955–56. By this time, Hofstra had become classified as a Division I institution. In 26 games played, he averaged 26.9 points and 24.2 rebounds en route to a third consecutive All-Metropolitan area selection. He repeated as a Look magazine All-American, and he was also selected as the Haggerty Award winner. The Haggerty Award has been given annually since 1936 to the New York City metropolitan area's top male collegiate basketball player, and Thieben was the first Hofstra player to receive it. In just 76 career games, Thieben scored 2,045 points and grabbed a school record 1,837 rebounds. While he still remains in the top 10 all-time for scoring at Hofstra, his rebounding mark is considered unbreakable. The second highest rebounder in program history is John Irving, who only amassed 1,186. Thieben still holds Hofstra records for career scoring and rebounding averages, as well as single game scoring and rebounding records. In 2008, Hofstra University officially retired his jersey.
Professional career
After a standout college career, Thieben was selected in the 1956 NBA draft by the Fort Wayne Pistons. Thieben's career spanned two seasons, and between the two he had his most success during his rookie campaign in 1956–57. Playing for the Fort Wayne Pistons, he appeared in 58 games while averaging 4.1 points and 3.6 rebounds per game. Fort Wayne finished in third place in the Western Division with a 34–38 overall record, but did advance to the first round of the playoffs. After his rookie season, the franchise relocated to Detroit, Michigan and became the modern day Detroit Pistons. Thieben's statistics dropped to 3.7 points and 2.4 rebounds in 27 games played. The Pistons advanced further into the playoffs but still did not win the championship, and after two years Thieben's professional career was over.