Wilson was born in Handsworth, Birmingham and attended St Mary's Council School and Handsworth Grammar School. He began his football career during the amateur era, joining Hamstead Swifts in 1877 before transferring to Aston Unity three years later. In September 1885 he moved to Stoke, but did not remain at the club for long as later that year he began playing for Walsall Town, the club that later merged with Walsall Swifts to form Walsall F.C.. Wilson signed for Aston Villa in August 1886 before re-joining Walsall Town twelve months later. He remained at the latter club for just one month, then turned professional with West Bromwich Albion in September 1887. He scored twice on his Albion debut against Wednesbury Old Athletic in October 1887, helping his club to a 7–1 victory in the FA Cup first round, and was a member of the team that beat Preston North End 2–1 in the 1888 FA Cup Final. 1888–89 was the first season of the newly formed Football League; Albion were one of the twelve founder members and travelled to Wilson's former club Stoke on 8 September 1888 for their first league fixture. In the final five minutes of the match, Wilson scored Albion's first ever league goal, which helped his team to achieve a 2–0 victory. Joe Wilson missed two of the "Throstles" 22 Football League matches and scored four goals in season 1888-89 and was part of a midfield that achieved a big League win on two separate occasions. In August 1890, Wilson was transferred to Kidderminster Harriers, where he played for twelve months before a move to Birmingham St George's. He retired from playing football in April 1892 and from 1894 to 1910 was a Football League referee and linesman, officiating in First Division, Second Division and FA Cup matches, as well as at Non-League level. Wilson later worked as a goldsmith in Birmingham's Jewellery Quarter for 25 years prior to the Second World War. He died in Acocks Green, Birmingham on 20 October 1952. Described by one source as a smart, unobtrusive left-winger of dashing style and all-out aggression, Wilson kept defences on the alert with his cunning wing play.
