In his career Rahimić played for FK Velež Mostar on two occasions and also for FK Leotar. Thought to be very talented, Rahimić never did show the biggest talent that he had throughout his unfortunate short playing career. Rahimić was part of the Velež team that played the 1988–89 Yugoslav Cup final match against FK Partizan. He had to retire from football in 1991 at the early age of 28, because of a serious knee injury sustained in a Yugoslav league match while playing for Velež. He played over 80 league matches for Velež and over 100 matches in all competitions and almost 50 league matches for Leotar.
On 7 November 2013, Rahimić was named the new manager of Second League of FBiH club :hr:NK Sloga Ljubuški|NK Sloga Ljubukši. After a loss to HŠK Zrinjski Mostar in a cup game on 1 October 2014, Rahimić unexpectedly got sacked even though Sloga were at the time 1st placed in the 2014–15 Second League FBiH season.
On 14 June 2015, Rahimić became the new manager of Premier League of Bosnia and Herzegovina newcomer FK Mladost Doboj Kakanj. In his first season with Mladost, the club finished on 10th place in the league and made their goal of not getting relegated. After a terrific start to the next season, in September 2016, Rahimić made the decision to leave Mladost and to come back to Velež to once again be manager. At the end of the season Mladost finished 8th and once again secured at least one more season of playing in the Bosnian Premier League.
Return to Velež Mostar
On 26 September 2016, Rahimić was once again named the new manager of Velež Mostar. After two rough seasons, Velež under the command of Rahimić finally gained promotion to the Bosnian Premier League after finishing on 1st place in the 2018–19 First League of FBiH season. On 5 August 2019, after a series of poor results in which Velež lost three times in a row, Rahimić decided to resign from the position of manager after almost three years since his appointment in September 2016.
Return to Mladost Doboj Kakanj
On 10 September 2019, only one month after leaving Velež, Rahimić came back after almost three years to Mladost Doboj Kakanj and became their new manager. In his first game since his return to the club, Mladost lost 1–0 against Čelik Zenica away at the Bilino Polje Stadium in a league match. Rahimić's first win at Mladost after his come-back was a 1–2 away win in a cup game against NK Jedinstvo Bihać. On 27 November 2019, his contract with Mladost Doboj Kakanj was terminated after making bad results.
