Cummins joined Cobh Ramblers in 2006 and achieved promotion with them in his second season under Stephen Henderson. He scored 11 league goals as Cobh won the First Division, and he was named in the PFAI First Division Team of the Year. He continued to play for Cobh in the Premier Division in 2008, but they were relegated that year.
After Cobh were relegated from the league the following season, Cummins moved onto Waterford United, where he again linked up with Stephen Henderson, former Cobh Ramblers manager. He won the Munster Senior Cup with Waterford that year. Graham enjoyed great personal success in his first and only season with the club, he became one of the club's top scorers, scoring 17 league goals, and he was named in the PFAI First Division Team of the Year for the second time in his career.
Cork City
In March 2010 Cummins signed for his local club Cork City. Graham was called up to the Ireland U23 squad versus Estonia in September 2010. He played the full 90 minutes in a 1–0 away win. In October 2010 Graham was named in the PFAI First Division Team of the Year and won the PFAI First Division Player of the Year award. He finished the season as City's top scorer, and joint top scorer in the First Division with 18 league goals. Graham scored his first hat-trick for City in a 5–0 league win over Finn Harps on 15 April 2011. He scored the winner against St.Pats in the quarter final of the Ea sports cup.
Record Breaker
On 4 October2011, in a game against Monaghan, Cummins scored his 21st goal of the season, becoming the first ever Cork City player to score more than 20 league goals in a season. The previous record was held by Pat Morley, who had on two occasions scored 20 league goals in a season. He went on to score 24 goals that season including the goal that clinched the First Division title for Cork City away to rivals Shelbourne in the 94th minute of the final game of the season at Tolka Park
On 30 January 2012, Cork City announced that they had accepted a transfer bid for Cummins from Preston North End. On 2 September 2013, Cummins signed for Rochdale on loan until January 2014.
On 15 August 2014, Cummins signed a one-year contract with Exeter City on a free transfer following his release from Preston North End. Cummins made his debut in the 3–0 defeat at Home Park, coming on as a substitute. He was released at the end of the 2014–15 season
On 25 May 2015, Cummins signed a one-year contract with St Johnstone of the Scottish Premiership, and began his Saints career by scoring off the bench on his debut against Hearts at Tynecastle in a 4–3 defeat. Cummins made 92 appearances for St Johnstone, scoring 15 goals. His last goal for the club was in a win against Rangers at Ibrox.
Return to Cork City
Cummins signed for City on a two-year deal on 30 December 2017. He scored for City in a 4-2 win on his first competitive start against Dundalk in the 2018President's Cup at Oriel Park. On his first start in the league against St. Pat's on the opening night of the season, Cummins scored City's second goal of the night but was later sent off in a 3-2 away victory. On his return from suspension, Cummins scored a hat-trick as City beat Sligo Rovers 4-1 away from home.