John began his senior career at Queens Park as a fresh-faced 17 year old straight from the Giffnock North youth team. His time at Hampden was a fruitful one, with a goal record of better than 1 in 4 and his powerful play quickly attracted the attention of the big boys. Indeed, Gemmell was the top scorer in his last season with the Spiders
Gemmell was tipped as a future international player when he was signed by legendary Manager John Lambie as a 19 year old, in one of his last acts as Partick Thistle boss, and his progress was monitored under his replacement Gerry Collins. John was top scorer in Thistle reserves & made some appearances from the bench as Thistle struggled at the wrong end of the Scottish Premier League and he failed to score in 5 appearances in a poor side.
Manager Paul Martin, a former Queens Park teammate, signed Gemmell for Dumbarton in January 2005 after he was allowed to leave Firhill, and he signed an 18-month contract at The Rock.
Gemmell had his first taste of Junior football with Bellshill Athletic in the Premier Division, a spell which he speaks fondly of. After finding his feet, a goal glut whetted his appetite for another crack at senior football and he wasn't short of suitors, before eventually electing for a stint at Cliftonhill.
Albion Rovers
Gemmell's goalscoring exploits at Bellshill attracted attention higher up the leagues, and Albion Rovers boss John "Cowboy" McCormack stumped up a four figure sum in January 2008 to bring the towering hitman to Cliftonhill, where he penned an 18-month deal. Unsettled at the Manager's departure that summer, and keen to prove himself at a higher level, Gemmell was transfer listed at his own request at the end of the season.
Manager Danny Lennon signed Gemmell for Cowdenbeath in the summer of 2008 on a two-year contract, and his haul of 13 goals in 35 games made him a key player for Lennon as he guided the Blue Brazil to successive promotions on a shoestring budget. Goal v his former club Albion Rovers
Montrose
Former Hibernian defender Steven Tweed enjoyed a summer long pursuit of Gemmell in 2009 before he finally committed himself to the club on a two-year deal. It was an unhappy spell for the big hitman, as his work & home in Glasgow made the long trips north difficult. John returned to Albion Rovers for a second spell in August 2010.
Gemmell signed for Stenhousemuir in the summer of 2012 and he found a home in senior football at last. His strike rate of 29 goals in 50 appearances was his most prolific to date as he spoke warmly of being appreciated by supporters he had previously been heckled by when in opposition teams. His contract was not renewed by incoming Manager Scott Booth and he departed at the end of the season.
Clyde
After his third spell at Albion Rovers, Gemmell was signed for Clyde by Manager Barry Ferguson on 1 February 2016 as he was seeking a more physical foil for striker David Gormley. Initially signed on a short term contact until the end of the season, with a view to a longer stay, Gemmell left unhappy that summer stating that a verbal contract offer had been reneged upon, with a lesser offer on the table. On point of principle, Gemmell departed Broadwood a free agent.
Gemmell joined Scottish former Junior Cup winners Hurlford United in the summer of 2016. to play under former Stranraer player Darren Henderson. His goal to game ratio was good, however off the field strife saw him seeking a move once again.
After a very brief spell with Arthurlie, Gemmell joined Cambuslang Rangers. on 8 March 2017. With a First Division winners medal & a Super First promotion under his belt, not to mention an amazing goalscoring ratio of 57 goals in 64 games, Gemmell departed Somervell Park by mutual consent in January 2019.
Troon
Gemmell signed for Troon on 21 January 2019, alongside his former Cambuslang Rangers team-mate David Green. Gemmell re-invented himself as a towering central defender for the remainder of the season to help the Portland Parkers through an injury crisis, before returning to lead the line as the club's main striker for season 2019/20.