Construction on the two-storey mansion began in 1857, and it was completed in 1860. The architect was Spires Boling. He designed it as a combination of Greek Revival and Gothic Revival architectural styles. It has a portico with four Corinthian columns flanked by octagonal turrets on both sides. The tympanum of each tower has lunette windows. It was built for Colonel Harvey Washington Walter, a lawyer who served as the President of the MississippiCentral Railroad. During the American Civil War of 1861-1865, Walter, who was opposed to secession, invited Union General Ulysses Grant to live in the house. As Confederate General Earl Van Dorn liberated Holly Springs, he was not permitted to enter the house until Julia Grant had gone outside. Moreover, the house could not be ransacked. As a result, it was used by Confederate personnel and intelligence officers. Other sources, including Julia Grant's memoirs, give a slightly different version of events saying that she had left Holly Springs before Van Dorn and his troops arrived. Some of the troops attempted to remove her personal belongings from the house, but were prevented by Mrs. Pugh Govan, who was looking after Walter Place. Julia Grant's carriage was burned and her horses taken, but this would have been in line with Van Dorn's plan to remove or destroy anything in the area that may have benefited the Union army. A decade later, during the yellow fever epidemic of 1878, the mansion was used as a quarantine hospital for patients. Colonel Walter and three of his sons died from the disease that year and the mansion was then inherited by his widow, Fredonia. In 1889, it was purchased by her son-in-law, Oscar Johnson, husband of daughter Irene. Johnson was a co-founder of Roberts, Johnson & Rand Shoe Company, a shoe company in St. Louis, Missouri later known as the International Shoe Company. The Johnsons added a formal landscape garden and summered at the mansion. In 1903, they hired German-born architect Theodore C. Link to remodel the house. In 1918, two years after Johnson's death, his widow sold the house to A. M. Green. Green, who was a Ford car dealer, redeveloped the garden. However, by 1934, Johnson's children purchased the property again at an auction, for US$4,000. However, it was mostly lived in by hired help. The mansion was acquired by preservationists who restored it in the 1970s. It was listed as the most expensive house in Mississippi in 2011, for US$15 million. It was sold at an auction in 2014.
