Born in Orleans, Vermont, Stafford played in the hotel leagues with Oneonta in 1911 and Saranac Lake in 1912. In 1912, Stafford received a scholarship from Tufts University where he was chosen as the senior class president. Stafford was a star sprinter and captain of the school's baseball team. In 1916, the Tufts baseball team went 18–1 but lost to Harvard for the college championship of the East. An article in the Boston Herald said the following of Stafford: "He has well earned the right to be called the fastest base runner in college baseball, as his record of 22 stolen bases shows. His work at second base is no less notable, for he has taken everything that has come his way, and out of 83 chances he has made five slipups." Stafford ended up batting.404 and leading the nation with 30 runs scored and 24 stolen bases.
Stafford graduated from Tufts in June 1916 and signed a contract with the New York Giants. After a short stint in the minors, where he played as a left fielder and shortstop, the Giants called Stafford up to the big leagues at the end of the 1916 season. Stafford sat on the bench for the Giants until October 5 – the last day of the season. With two outs in the top of the ninth inning, the Giants trailing by two runs, and the bases empty, the rookie from Vermont was sent in as a pinch hitter for the Giants' pitcher. Stafford hit into a game- and season-ending out for the Giants, as the Brooklyn Dodgers won the pennant.
His pinch-hit out on the last day of the 1916 season turned out to be his only major leagueat bat. Stafford was offered a job as a research chemist with a textile company and opted for business rather than baseball. In February 1917, Giants manager John McGraw tried to persuade Stafford to give baseball another try. Stafford saved a letter McGraw sent offering "to take you south with me and give you a thorough spring schooling in base ball." McGraw opined that there was "enough promise to you to make me positive that it is worth your while" and cautioned Stafford against "wasting a first class opportunity." Despite McGraw's personal plea, Stafford decided to pursue his work in the textile business. Stafford returned to baseball briefly during World War I, playing in the industrial leagues where his wartime teammates included Chief Bender and Home Run Baker.
Life after baseball
After the war, Stafford returned to work in the textile business, working on the development of nylon. He retired from the textile business in 1941 and bought a Vermont dairy farm with a house built in 1832. He gave up farming in the 1950s and went into the real estate business and was later elected to the Vermont General Assembly from Bethel, Vermont. Stafford died at age 80 in 1972 while spending the winter in Lake Worth, Florida.
