Holland was born in Bunnythorpe and educated at Palmerston North Boys' High School. An opening bowler who also often made useful runs in the middle and lower order, Chester Holland spent most of his career playing non-first-class cricket for Wanganui. In 1909-10 he took 6 for 58 against the touring Australians. In 1912-13, when Wanganui played their first match in the Hawke Cup, Holland took 5 for 14 and 3 for 11 against South Taranaki, in a match Wanganui won by an innings and 393 runs. In 1913-14 Wanganui dominated the HawkeCup, winning all three matches, Holland taking 33 wickets at an average of 8.39. He took 4 for 79 for Wanganui against the touring Australians in February 1914, and after New Zealand's loss to Australia in the first of two international matches a few weeks later, several critics urged the selectors to choose talented players from outside the four main teams. The cricketer and clergyman Ernest Blamires said that of all bowlers in New Zealand none had impressed him as favourably as Holland: "He is a fast-medium bowler, and the off break that he gets on a fast wicket is remarkable." Holland was selected for his first-class debut in the second "test" as one of seven changes, alongside Len McMahon from Poverty Bay. However, Holland took only one expensive wicket and New Zealand lost by an innings. He served as a rifleman in the New Zealand Rifle Brigade in World War I.
Later career
Wanganui retained the Hawke Cup in 1914-15, when Holland took 24 wickets at 15.37. They finally lost the title to Poverty Bay in March 1919, despite Holland's 12 wickets for 83 in the match. In all club and representative matches in 1919-20, Holland took 94 wickets at 12.72 and made 934 runs at 44.47. After taking 6 for 91 for Wanganui against the touring Australian team in March 1921 he played his second first-class match for a Minor Associations XI against the Australians a few days later, but took only one wicket. In 1922-23, when Wanganui again dominated the Hawke Cup, Holland took 10 for 35 and 4 for 44 against South Taranaki, the only instance of a bowler taking all 10 wickets in an innings in the Hawke Cup. At the age of 35 Holland played his first Plunket Shield match in 1923-24, for Wellington against Auckland, scoring 54 in the first innings and taking three wickets in a 365-run victory for Wellington. He played one more Plunket Shield match that season and another in 1924-25, but with little success. He returned to Hawke Cup cricket, taking 21 wickets in 1927-28 when Wanganui regained, but then lost, the title.