Whitty played in the first Test of the series, recording figures of 0/43 and 0/18 as England posted a dominant 10 wicket victory. Whitty was replaced for the second Test, which Australia won, along with the third, in retaining the Ashes. Despite his struggle to hold on to his Test position, Whitty took 77 wickets on the tour, at the impressive average of 20.42. On his return home to Australia, he continued to play for South Australia in 1909–10, helping them to win the Sheffield Shield for the second time in their history. In the final match of the season against New South Wales, Whitty took 5/43 as his former team was dismissed for just 92 in their first innings. Whitty's six-foot tall frame allowed him to swing the new ball considerably, and he also bowled reasonably quick left-arm orthodox deliveries with the older ball. He was seen as the ideal partner for fast bowlerTibby Cotter, and the pair opened the bowling at home against South Africa in 1910–11. This series has been described as Whitty's "greatest Test success", as he played all 5 Tests to take 37 wickets at the outstanding average of 17.08. Whitty took 8 wickets in the first Test, followed by 3 in the first innings of the second Test in Melbourne. In the second innings, with South Africa requiring 170 runsfor victory, Whitty produced one of the "most sensational" bowling spells by an Australian in the period, taking 6/17 in 16 overs as South Africa were bowled out for 80. Whitty's good form continued throughout the series, including a further 8 wickets in the third Test, and 5/79 for South Australia against the tourists. In the fourth Test, Whitty produced his best Test performance with the bat, making 39 not out in an 82-run partnership with Vernon Ransford, which remained a record for the 10th wicket in Tests between the two nations until it was broken by Mike Hussey and Glenn McGrath in 2005–06. Whitty was again selected in the Australian team for the first two Tests against England during their 1911–12 tour of Australia, but managed just 3 wickets at 61.67, and was left out of the team for the remainder of the five-Test series. Despite this performance, and partly due to a "boardroom brawl" which saw Australia leave behind many of its best players, Whitty was selected to tour England for the 1912 Triangular Test series, which also featured South Africa. The squad has often been described as "one of the worst teams Australia ever sent overseas", 10 of the 15 players having never travelled to England before. Whitty took 25 wickets in the 6 Test matches, including 7 wickets against England at The Oval, and 5/55 against South Africa at Old Trafford. He finished the tour with 109 wickets at 18.08, second only in averages to Charles Macartney. South Australia took their 3rd Sheffield Shield in 1912–13, with Whitty taking figures of 5/65 in Melbourne and 5/92 in Sydney. He was selected in the Australian team scheduled to tour South Africa in 1914–15, but the tour was cancelled due to World War I, effectively ending Whitty's Test career. During his Test career, Whitty also toured New Zealand, the United States, Canada and Bermuda. In the United States, at the end of the 1912 England tour, Australia incredibly lost to a Philadelphian team, with Whitty being one of only two players to score over 20 in Australia's first innings, before being bowled on the fourth delivery of the final over, with Australia needing 3 runs for victory.
Whitty continued to play domestically after the War ended, and was still good enough to regularly take 5-wicket hauls in first-class cricket up to the age of 38. Whitty played his final first-class game as New South Wales wrapped up the 1925–26 Sheffield Shield. A feature of Whitty's first-class career was his remarkable success bowling to his hero Trumper, with Whitty dismissing him seven times in ten innings – Trumper remaining not out in the other three. At lower levels, Whitty played for East Torrens in Adelaide from 1908 to 1915, consistently taking over 50 wickets a season, and leading district bowling averages for four consecutive years from 1911. He played for Glenelg from 1920 to 1927, and continued playing in the Mount Gambier region until 1937. He was also an enthusiastic golfer, and at one stage played off scratch. From 1938 Whitty lived on his property at Tantanoola, where he died aged 87, the longest surviving of Australia's pre-WWI Test cricketers.