At the end of Brian's first year at university he transferred to the St George Dragons rugby league club. While at St George he won three reserve-grade premierships and was kept out of the top grade by Reg Gasnier, Johnny Riley and Billy Smith who started with the club in the centres. Brian won 3 Second Grade Premierships and won a First Grade Premiership blazer in 1965. In 1962, in a Second Grade Grand Final, he scored from the kick off after St George kicked to the backs, the ball bounced once and then he scored under the posts. It is argued that this has been the fastest try in league as it was scored 10 seconds after the kick off. Brian then transferred to South Sydney in 1966 for four seasons where he played in three first grade Grand finals. Brian played 4 seasons as a winger for the Rabbitohs from 1966-1969. Brian played in the Premiership winning sides of 1967 and 1968. He played in the 1969 loss to the Balmain Tigers and crossed for Souths but was controversially ruled to have touched the corner post in the process. Brian then retired at the start of the 1970, at the age of 26 to pursue a career in transport and logistics.
Rugby League - representative career
Earning the recognition at Souths which he had been denied in the star-studded Saints lineups, James was selected for New South Wales in 1968 and made two appearances against Queensland. In 1968 he was called upon for Australia's Rugby League World Cup squad and appeared in Australia's 37-4 tournament win over France at Lang Park.
Professional Sprinting
From 1962 - 1969 during the off-season Brian traveled throughout Australia to attend professional sprinting gifts in locations such as Devonport, Macksville, North Sydney and Coonabarabran.
On 9 February 1968, Brian and Jack Thom, organised the first official touch football tournament at Redfern Oval. All but 2 Sydney First Grade teams took part in the event. The event was billed as the "South Sydney Charity Night" with proceeds going to the Spastic Centre. James and Thom along with the NSWRL Referees Association recorded the rules in the event program, that being 7 players per side plus 2 reserves, each half duration being 7 minutes, the field is 70 yards by 40 yards and a player is "tackled" when he is touched with two hands by an opposition player.