Rosen is Jewish, from the Colonia section of Woodbridge Township, New Jersey, played for the Penn Quakers men's basketball team from 2008 to 2012. As a freshman, he immediately moved into the starting lineup, averaging 8.5 points and 5.0 assists per game. At the close of the season, he was named Philadelphia Big 5rookie of the year. From there, Rosen became a fixture on the All-Ivy team – earning first team honors as a sophomore, junior and senior. As a senior, Rosen led Penn back to the postseason for the first time in his career, as the Quakers finished the season 20–13 and made it to the second round of the 2012 College Basketball Invitational. Rosen led the Ivy in scoring at 18.2 points per game and finished third in assists. He was unanimously named the 2012 Ivy League player of the year. Nationally, Rosen was a semi-finalist for the Bob Cousy Award and a finalist for the Lowe's Senior CLASS award. Rosen was also named an honorable mention All-American by the Associated Press. The first three-time captain in program history, Rosen graduated as the Penn men's basketball program's all-time leader in assists, games started and minutes played, and his point total is third behind only Ernie Beck and Ugonna Onyekwe. In his final season, Rosen set program single-season marks for assists, starts and minutes played, while his point total was the best since Tony Price scored 633 points in 1978–79. Rosen also hit 75 three-point field goals in 2011–12, the seventh-best single-season total in program history. In addition to leading Penn in scoring, assists, three-pointers and free throws made, Rosen was second on the team with 46 steals. He scored in double figures a team-high 31 times in 33 games—including 17 in a row to end the season—and had 13 games with 20 or more points including six with 25 or more. Rosen had three double-doubles, all coming via a points-assists combination. On May 12, 2012, The University of Pennsylvania gave out its Senior Class Leadership Awards at College Hall as part of the weekend's Commencement ceremonies. At the ceremony, Zack Rosen, was presented with the Spoon Award and the Class of 1915 Award by University PresidentAmy Gutmann.
On August 2, 2012, Rosen signed his first professional contract with Hapoel Holon of the Israeli Basketball Super League. On August 28, 2013, Rosen signed a 2-year contract with his second professional team Hapoel Jerusalem B.C. On November 28, 2013, Rosen signed a 1-year contract with his third professional team Maccabi Ashdod B.C. of the Israeli Basketball Super League. On July 13, 2014, Rosen re-signed with Maccabi Ashdod B.C. Rosen sustained a back injury during the 2014/15 season and was released by Ashdod during the off-season. Rosen won the 3-point shootout in the Super League All Star Game in 2014 and 2015.