Kiss started his professional career at Inter Bratislava in 2008, before moving to Petržalka the following year where he made 23 league appearances. He again moved in 2010 to ŠK Slovan Bratislava.
On 21 July 2011, Kiss joined Welsh club Cardiff City, who play in the Championship, on a season long loan. He made his debut for the club in a pre-season loss to Bournemouth coming as a substitute. After the game, both Kiss and Cardiff manager, Malky Mackay stated they wanted to extend the deal past the season long loan. His first start for the Bluebirds was against Yeovil Town and the following day he was given the number 4 shirt for the season. However Kiss missed the first six games of the season with a hamstring injury. On 26 August, Malky Mackay confirmed he would be part of the squad to play Portsmouth the following day Despite making the bench Kiss didn't make an appearance in the 1–1 draw. He made his debut in a 2–0 win over Doncaster Rovers, he came on as a substitute for Craig Conway. Kiss made his full debut the following game in a 1–1 draw with Blackpool. His first goal for the club came against Derby County on 2 November. Kiss was used as a substitute in the LeagueCup final against Liverpool, which ended in a 3–2 penalty shootout defeat. It was confirmed on 1 July that an agreement had been reached between Cardiff City and Slovan Bratislava to allow Kiss to sign for the Bluebirds on a permanent basis. Kiss's first game as a permanent Cardiff player, came on 17 August 2012, against Huddersfield Town where he came on as a substitute for Jordon Mutch. He played 100th professional game on 5 January 2013, in the FA Cup against Macclesfield Town. Kiss's game-time for the first team was limited in 2012–13, as the Club won the Championship, though the midfielder was a regular in the club's development squad.
On 8 January 2014, Kiss signed for Scottish Premiership side Ross County on loan until the end of the season. He made his debut on 11 January 2014, scoring twice in a 3–3 draw against Partick Thistle. He scored two more in his next game, a week later: for the second, he "picked up the ball away from the Dundee United goal and sent a curling ball into the top right-hand corner." Kiss returned to Cardiff at the end of his loan having scored six times in 17 appearances. On 6 August 2014, Ross County announced they had re-signed Kiss on a season-long loan.
