Sarpong joined AFC Ajax when he was just seven years of age, and signed his first contract in 2005. At the time Chelsea were interested in signing the player, but he decided to stay with Ajax. He made his Dutch League debut on 5 February 2006 in the 3–2 away defeat against Feyenoord. Sarpong played in eight more league matches during the season. In addition he and his team won the KNVB Cup, but in the 2006–07 season he did not play a single league match. In July 2007, Sarpong extended his contract, which kept him until 2011. However, the following season he became first-team regular under new coach Marco van Basten netting his first goal in a 2–2 away draw against no other than Feyenoord. A week later, on 2 October 2008, he scored again, in the first round of UEFA Cup; second leg, against Borac Čačak. The 2009/10 season was difficult for Sarpong to gain back his valuable first-team experience by being placed on a loan list. Having yet make his first league appearance for Ajax this season, Sarpong says he's very "eager" and "desperate" to make a return in the first team. On 31 December 2009, Ajax loaned the 21-year-old Dutch youth international to NEC until the end of the 2009–10 season. He made his debut for the club, in a 2–1 win over Vitesse Arnhem. In the quarter final of KNVB Beker, against his former club, Sarpong provided assist for the second goal for the club in a match, but was sent off after a second bookable offense, as NEC lose 3–2. Two months later, on 19 March 2010, he was sent off again in the last minutes, as NEC heavily lose 4–1 against Heerenveen. Having made an impressive start at NEC, Sarpong hints he might earned a spot in the World Cup. At the end of the 2009/10 season, it announced that the club have decided against to sign Sarpong on a permanent basis. He made sixteen appearance in all competitions.
On 2 August 2010, it emerged that the La Liga side Real Sociedad were interested in Jeffrey. But no official bid was made until the 15th. On the 21st it was rumoured he was in San Sebastián and on the following day Real Sociedad confirmed the signing of Jeffrey Sarpong for an undisclosed fee. Sarpong was given the number 14 shirt. After his debut was delayed over injuries and problem, Sarpong finally his debut on 3 October 2010 in a 1–0 home victory to Espanyol and the next game, on 17 October 2010, Sarpong scored his first goal in a 2–1 loss against Levante. A week later, on 28 October 2010, Sarpong scored again, in the fourth round of Copa Del Ray; first round, in a 3–2 loss against Almería. He soon went on the sidelined after sustaining a dislocated shoulder during a training-ground clash, which left him out for a months. But made his return on 6 November 2010, in a 1–0 win over Racing Santander. Despite a promising start at the club, Sarpong had a disappointing season, having made 18 appearance. The next season, even his first team became increasingly limited, under manager Philippe Montanier and made only three appearance. On 5 January 2013, Sarpong terminated his contract at Sociedad by mutual consent after three-year at the club.
Loan spell
On the last day of the winter transfer window, Sarpong joined NAC Breda on loan for the rest of the season. On 11 February 2012, he made his debut for the club, coming on as a substitute for Ömer Bayram, in a 2–0 loss against his former club, Ajax. On 28 April 2012, Sarpong scored his first goal for the club, in a 3–1 win over Utercht. On 30 August 2012, it announced that Sarpong joined Segunda División side Hércules for the rest of the season. He made his debut for the club, on 2 September 2012, in a 1–0 loss against Alcorcón after coming on as a substitute in the 80th minute. After five months at the club, Sarpong left the club, following his release from Real Sociedad.
Return to NAC Breda and free agency
After a trial with Premier League side, Stoke City as well as Football League Championship club, Sheffield Wednesday in January, it was announced on April 9, 2013 that Sarpong had rejoined NAC Breda on a three-year deal with the club, starting in the next season. The deal was cut short, and Sarpong was released at the end of the 2014–15 season. He has since been on trial with Football League Championship team, Blackburn Rovers, and appeared in a friendly match against Tranmere Rovers, scoring his side's first goal. The match concluded 2-0 to Blackburn.
Wellington Phoenix
Sarpong joined Wellington Phoenix FC after he signed for them on 25 August 2015, he was released on 31 January 2016 by mutual consent.