His first goals for the Nailsworth club came in a 4–1 win over Alfreton Town as Taylor netted a hat-trick. He went on to score a further seven goals as Forest Green finished 10th in the Conference Premier. In his second season at the club he scored 11 times in league and cup competitions, earning himself a contract extension to summer 2014. He struggled for form in his third season and was loaned out to fellow Conference Premier club Chester in January 2014 until the end of the season. Having scored six times in seven matches, he was recalled by his parent club, but failed to score again in his remaining 12 appearances.
In June 2014, Taylor signed for recently relegated Conference Premier club Bristol Rovers, reportedly rejecting offers from former club Oxford United and Chester as well as Mansfield Town and Kidderminster Harriers. His Bristol Rovers career got off to a difficult start as he scored just three times in his first 18 matches. He finished the season with 20 goals, including one in each of the play-off semi-final matches against Forest Green Rovers. He played the full 120 minutes of the play-off Final and scored Rovers' second penalty of the shoot-out as Rovers secured an immediate return to the Football League. Taylor scored his first Football League goal in a 3–1 win against Barnet. A successful start to his season resulted in Taylor scoring eight goals in all competitions before mid November, including two goals against Carlisle United. Taylor reached 14 goals in all competitions before Christmas, including hat-tricks in a 3–0 victory against Wycombe Wanderers and a 4–1 win against Hartlepool United. On the final day of the season, Bristol Rovers achieved promotion to League One by scoring a dramatic winner in the 92nd minute. Lee Brown scored the decisive goal after Taylor himself hit the post. Taylor finished the season with 27 goals and five assists, outscoring every player in the Football League. Taylor proceeded to score on his League One debut against Scunthorpe United in a 3–1 loss. On 18 October 2016, Taylor scored a second-half hat-trick to earn a point for the Rovers against Milton Keynes Dons in a 3–3 draw.
On 31 January 2017, Taylor left Bristol Rovers to join rivals Bristol City, activating the release clause reported to be £300,000. Taylor became the first player to move directly from Bristol Rovers to Bristol City since Trevor Morgan in 1987. In October 2017, as part of an interview for the BBC Points West programme, Bristol City manager Lee Johnson described how he received a death threat during the 2016–17 season after signing Taylor. During this episode Johnson moved house after his family's home address was put online. On 11 February 2017, Taylor made his first start for Bristol City, in a league match away to Derby County. He scored his first goal for the club in the 14th minute, firing home from close range after teammate Aden Flint saw his header cleared off the line. Taylor would go on to play a key role in City's next two goals, the match eventually ending 3–3. During the 2017–18 season Bristol City reached the semi finals of the EFL Cup and Taylor scored in the victories against Premier League opponents Stoke City and Crystal Palace, as well as setting up the 93rd-minute winner in the quarter-final victory over cup holdersManchester United.
Oxford United (loan)
On 19 August 2019, Taylor joined Oxford United on loan till the end of the season. He made his debut in a 4–2 League One defeat to Burton Albion on 20 August 2019, and scored his first goal in a 6–0 away victory over Lincoln City on 21 September. He finished the COVID-affected 2019–20 season as top scorer for the club, scoring 17 goals. On 31 July 2020, he signed a three-year permanent deal with Oxford.