The club was formed in 2011 following the amalgamation of two successful Sunday league clubs Baffins Milton and Milton Rovers. Both clubs had won several league and cup titles in the Portsmouth Dockyard and Meon Valley leagues. The new club joined the Premier Division of the Portsmouth Saturday League and were champions in their first season. After finishing as Premier Division runners-up the following season, they moved up to the Senior Division of the Hampshire Premier League. Baffins Milton Rovers were Hampshire Premier League champions in their first season in the league. They also won the League Cup with a 4–0 win over Colden Common in the final, and the Portsmouth Senior Cup, beating Moneyfields 4–0 in the final at Fratton Park. After finishing as Senior Division runners-up in 2014–15, the club were champions again in 2015–16, as well as winning the Portsmouth Senior Cup for a second time after beating Havant & Waterlooville’s Southdowns College Team 3–1 in the final. As Hampshire Premier League champions and having moved to their new Kendall Stadium, Baffins were promoted to Division One of the Wessex League for the 2016–17 season. They went on to finish as runners-up in the division, earning promotion to the Premier Division, as well as reaching the Wessex League Cup final, eventually losing 2–1 to Premier Division Sholing.
Ground
The club initially played on the southern pitch at the Langstone HarbourSports Ground. In 2015 they obtained a 50-year lease from Portsmouth City Council for the northern section of the sports ground and started to develop it in preparation for promotion. They moved to the new ground in time for the 2015–16 season, and it was named the Kendall Stadium after one of its sponsors. Developments included a new 120-seater stand, changing rooms, perimeter fence and concreting, with £70,000 in grants contributing to the £100,000 costs. Further upgrades in summer 2016 included new floodlights, dug-outs and spectator toilets. A £33,189 grant from the Premier League through the Football Stadia Improvement Fund part-funded the £50,000 costs. The upgrades allowed the club to be accepted for promotion to Wessex League Division One for the 2016–17 season, having won the Hampshire Premier League for the second time in 2015–16. The new ground was officially opened on 3 August 2016 in a pre-season friendly match with Salisbury. A new clubhouse was opened during 2017–18 season, with a new covered terrace also built. Portsmouth F.C. Women began sharing the ground at the start of the 2018–19 season. After a new sponsorship deal, the stadium is now called to the PMC Stadium, after the sponsors, PMC.