Milošević began his career playing for Rissne IF and later transferred to Vasalunds IF. Operating as a striker till the age of 17, at Vasalund he first switched position to the central midfield and was then persuaded to move back to the central defense where he flourished. During the 2010 season he scored five times for Vasalunds IF, one from a penalty kick.
On the first of February 2011 he signed a four-year contract with his boyhood favourites AIK after a long and drawn out process that included training with AIK rivals Djurgårdens IF. He has also trained with Scottish club Celtic and Serie A club Fiorentina. When AIK defender Per Karlsson was injured during pre-season training, Milošević was selected to play from start in the first home game of the 2011 season against Mjällby. AIK won the match and Milošević received a lot of attention, not only for being named man of the match, but also for receiving a martial arts inspired kick to the head from MjällbysPeter Gitselov. During a home game against Malmö FF on 12 June, he provided his first assist for the club. Liverpool, Arsenal, Spurs and Sunderland all had scouts keeping a very close eye on the young defender. Serbian club FK Partizan and several Dutch clubs, including Ajax have also shown an interest. Bundesliga club Werder Bremen made an official bid for 600,000 euros, a bid that AIK turned down. His agent said that it would be good if the young player stayed with AIK for at least a year before moving on to a bigger club, but adds that if a good deal is offered, it is hard to turn it down. He made his first goal in a home draw against GIF Sundsvall on 22 April 2012.
On 7 January 2015 Milošević signed a 3.5-year deal with Turkish club Beşiktaş for a fee of €1 million. On 18 December 2017, his contract was mutually terminated.
On 17 August 2016, Milošević signed a season-long loan deal with Bundesliga side SV Darmstadt 98. He said: "Everybody who has played in the Bundesliga wants to stay there."
On 28 February 2018 AIK announced they had signed an agreement with Milošević until 31 December 2018. Milosevic played in 27 games as AIK won the 2018 Allsvenskan.
On 1 February 2019, Milošević signed an eighteen-month contract with EFL Championship side Nottingham Forest. He scored his first goal for Nottingham Forest in a 3-0 win over Middlesbrough on 22 April 2019. On 28 October 2019, Miloševićs contract was terminated by mutual consent. On 29 July 2020, Milošević joined Danish Superliga side Vejle BK on a free transfer, signing a two-year deal.
