The club was formed in 1919 as SK Građanski. Jaroslav Daneš was the club president, Stevan Kolarović the club secretary, and the first team was formed by: Gena Gecinger, Sepika Kin, Sergije Vetvinski Rus, Pera Petrović, Voja Srnić, Aleksije Petrović, Boža Repanić, Ozren Popović, Lajos Horváth, Heinrich Weiss, Victor Weiss, Dragutin Vasilić and the reserve was Vlada Tepšić. The first team coach was Heinrich Weiss who was simultaneously a player and team top scorer. In 1924 the team starts competing in the Belgrade League within Kingdom of Yugoslavialeague system among other 12 teams, so the club direction brings the first professional coach, Austrian Rudolf Klick, who stayed in the club in the following 15 years. In 1925 it reached the final losing against one of the greatest national clubs, BSK Belgrade. Građanski also won several local competitions and during that period and a number of other clubs from Sremska Mitrovica were merged into Građanski, namely Viktorija, Posavina and Trgovački. After the league reorganization in 1928, Građanski became a member of the Novi SadFootball Association League, one of the Yugoslav Second Leagues in that time, who's winners were promoted to the Yugoslav Football Championship. Although it never achieved promotion, it competed in that level until the Second World War. Miladin Tintarović is one of the most notable persons in the club's history. He became club secretary in 1932 and during the war he was kept in captivity by the Axis forces. After the war he recreated the club under the name SK Jedinstvo. The new communist authorities were deciding which clubs should be disbanded and which should stay, on the criterium of which kept activity under occupation, and after Zina Mongerštern request, the club was allowed by the court to continue activity. Tintarović was elected again to be the general secretary, and while the club was renamed into FK Srem, the club kept their old colors, white & black. Between 1945 and 1992 the club plays in the Yugoslav Second League and Third League. During the 1990s the club falls into lower leagues, all the way until 2002 when it is merged with top league FK Zvezdara and becomes member of the Second League of FR Yugoslavia, a league which was renamed in 2006 into Serbian First League.
Recent seasons
Current squad
For the list of current and former players with Wikipedia article, please see: :Category:FK Srem players.