Joseph was drafted by the New York Yankees in the fourth round, with the 140th overall selection, of the 2008 Major League Baseball Draft out of Franklin High School. He signed with the Yankees on June 10. Joseph joined the Rookie-level Gulf Coast Yankees. In 2009, he played for the Class-A Charleston RiverDogs, where he named the South Atlantic League's player of the month for July and a post-season all-star third baseman despite playing just 37 games at third. He began the 2010 season with the Tampa Yankees of the Class A-AdvancedFlorida State League, where he had a.302 batting average, six home runs and 52 RBIs before he was promoted to the Trenton Thunder of the Class AAEastern League in August. Joseph spent the entire 2011 season with the Thunder. He was added to the Yankees 40 man roster on November 18, 2011. In 2012, he played for the Scranton/Wilkes-Barre Yankees of the Class AAAInternational League. After starting the 2013 season with Scranton/Wilkes-Barre, the Yankees promoted Joseph on April 30, when they placed Kevin Youkilis on the disabled list. However, he was optioned to the minors two days later without appearing in a game. The Yankees recalled Joseph on May 13 as the 26th man in a doubleheader against the Cleveland Indians, starting him at first base during the first game and second base in the second game. During the second game of the doubleheader, Joseph got his first career base hit. He was then optioned back to Scranton/Wilkes-Barre after the doubleheader. Joseph was outrighted off the Yankees roster on November 20, 2013. He was released by the Yankees on August 27, 2014.
2015–2017 seasons
On November 19, 2014, he signed a minor league deal with the Atlanta Braves. He was released by the Braves on June 2, 2015. On June 16, 2015, Joseph signed a minor league contract with the Baltimore Orioles. He elected free agency on November 7, 2016. On November 19, 2016, he agreed to terms with the Washington Nationals on a minor league deal with an invitation to spring training, although he was reassigned to minor league camp on March 13, 2017. He elected free agency on November 6, 2017.
Baltimore Orioles
On February 19, 2018, Joseph signed a minor league deal with the Orioles. Joseph was recalled to the majors on June 15 and started at first base, it was his first major league appearance in over five years. He was optioned to the AAA Norfolk Tides on June 20. He was designated for assignment on June 29. He had his contract purchased again on September 7, 2018. He was outrighted on November 1, then resigned a minor league deal on November 5.
On September 3, 2019, Joseph was claimed off waivers by the San Francisco Giants. On September 14, the Giants designated Joseph for assignment.
Pittsburgh Pirates
On September 16, 2019, Joseph was claimed off waivers by the Pittsburgh Pirates. Joseph was outrighted off the Pirates roster on October 25 and elected free agency on October 31.
On January 31, 2020, Joseph signed a minor league deal with the Chicago Cubs. Joseph was released by the Cubs organization on May 28, 2020.
Personal life
Joseph's brother, Caleb, has also played in MLB. Caleb was also selected in the 2008 draft; he was chosen by the Baltimore Orioles in the seventh round. They played together with the Orioles in 2018. Their father, Mark, played college baseball for Lipscomb.