Cicilia spent his youth with KVC Oranje, FC Kerkrade-West, and Alemannia Aachen, before joining the youth academy at Roda JC Kerkrade. He was one of a club record eight youth team players offered a professional contract at Roda JC in June 2013. He made his debut in the Eerste Divisie on 25 August 2014, coming on for Danny Schreurs 78 minutes into a 3–0 defeat to FC Volendam at the Kras Stadion. He scored his first goal for the club on 23 September, in a 2–1 KNVB Cup victory over SC Heerenveen at the Parkstad Limburg Stadion. Four days later he scored his first league goal, in a 2–1 win over Helmond Sport at the Stadion De Braak. He ended the 2014–15 season with two goals in 23 appearances, though was not used in the play-offs as Roda JC beat NAC Breda to regain a place in the Eredivisie, and signed a new one-year contract in March 2015. He made two appearances in the Eredivisie as a substitute in August 2015, before joining Eerste Divisie club RKC Waalwijk on loan for the rest of the 2015–16 season. He made a total of 24 appearances for the club, scoring seven goals, including a hat-trick in a 5–3 home defeat to Jong Ajax on 4 December, as RKC Waalwijk finished second-from-bottom in 18th place. He was released by Roda JC in May 2016. He had a trial at Austrian Bundesliga side SKN St. Pölten in June 2016.
Port Vale
In June 2016, Cicilia signed a two-year contract with EFL League One club Port Vale. He started just two of the opening ten games of the 2016–17 season and found himself competing with Martin Paterson behind Anton Forrester in the first team pecking order; Cicilia said that additional conditioning work helped him to adjust to the physicality of the English game. He scored his first goal for the club on 22 October, and then won a penalty, as the "Valiants" came from behind to draw 2–2 with Oxford United at Vale Park. His size and unconventional playing style quickly made him a 'cult hero' for Vale fans, who nicknamed him 'Reggie'. However Bruno Ribeiro rarely played Cicilia form the start of matches, believing him to be more of an impact substitute. He was sidelined with a calf strain injury in February. He returned to action after a four-week absence, but failed to add to his goal tally, and was sent off for two bookable offence on the final home game of the season – a 2–0 defeat to Bolton Wanderers on 22 April; caretaker-manager Michael Brown said that the sending off was harsh. He left Port Vale following the club's relegation in May 2017 after he and Brown came to a mutual agreement to end his contract.
FK Sūduva
In October 2017, Cicilia signed with Lithuanian A Lyga club FK Sūduva. He played three games for the "Suvalkiečiai" in 2017 as they won the leaguefor the first time in their history. He played and scored in the 2018 Lithuanian Supercup as Sūduva recorded a 5–0 victory over Stumbras. On 11 July, he scored his first career hat-trick as Sūduva beat Cypriot champions APOEL 3–1 at the Sūduva Stadium in the first leg of the first round of qualifying for the UEFA Champions League; he completed his hat-trick within 19 minutes of the kick-off. He was named in A Lyga's Team of the Month for June and July, though this was reported as being primarily due to it being a poor month for attackers in the division. Sūduva went on to retain their league title in 2018.
FC Eindhoven
On 19 February 2019, Cicilia signed with Eerste Divisie side FC Eindhoven on a contract to run until summer 2020. Head coachDavid Nascimento stated that "He is a big boy, physically strong, good at the ball and someone who can score a goal". He had to wait 12 games before scoring his first goal of the 2019–20 season, at which point he scored four goals in two games against AZ Alkmaar II and SBV Excelsior. He ended the campaign with 11 goals in 31 games for the "Blauw-witten", before his contract was terminated on 1 April due to the COVID-19 pandemic in the Netherlands.
Slovácko
On 1 July 2020, Cicilia joined Czech First League club Slovácko on a two-year contract; head coach Martin Svědík signed him to replace departing striker Tomáš Zajíc.