The village of Babington dates from medieval times. Its name derives from the Babington family, who were once associated with the village, but it appears to have been for the most part demolished to make way for the house around 1705. The manor was sold by Thomas and Mary Mankham to Joan Elcode, a widow, according to a deed dated Easter 1572. The estate then contained 7 messuages, one cottage, 10 tofts, 1 water mill, 10 gardens, 14 orchards, 300 acres of land, of meadow, of pasture, of wood and of furze and carried an annual rent of 4 shillings and of pepper. The estate passed through several hands until it was forfeited to the Crown in 1593. By the late 17th century, the manor belonged to Thomas Pacey who left it to his sister, Margaret. She was married to a Bristol alderman, William Crabb, and subsequently passed the manor on to their eldest daughter, Elizabeth, wife of Henry Mompesson of Corston, Wiltshire who was Sheriff of Somerset in 1698. The current house was built around 1705 for Henry Mompesson, probably on the foundations of an earlier building which would have been owned by the Babington family. It has since been extensively altered and extended, including in 1790, possibly by John Pinch the elder, for Captain Charles Knatchbull, who had inherited it via Mrs Elizabeth Long, a niece of the Mompessons. Babington was inhabited by successive members of the Knatchbull family until the house and immediate grounds were sold following the death in 1951 of Mrs Knatchbull, the widow of Wyndham Knatchbull, a captain of the 3rd Dragoon Guards.. Mrs Knatchbull was better known under her maiden name as the pianist and composer Dora Bright. In April 1939, BBC Radio broadcast a concert of her playing from Babington House. Adjacent to Babington House is the Grade I listedChurch of St Margaret, which is owned and operated by the St. Margaret's, Babington, Charitable Trust. The Grounds of Babington House are listed Grade II in the Register of Historic Parks and Gardens of special historic interest in England.
Hotel and private members club
In 1998, Nick Jones who had founded the Soho House club in Soho, London bought the property. He converted it to a hotel, club and wedding venue for the London members of the Soho House club, as well as for new Somerset members. The property is also part-owned by actor Neil Morrissey. In that year, Jones was cautioned by police after eleven Polish illegal immigrants were found working at the hotel. Wedding ceremonies are performed in St Margaret's Church or in the orangery. Weddings for non-members are allowed.
To the north of the House are lawns planted with 19th-century specimen deciduous and coniferous trees and ornamental shrubberies. From here there are views north and northeast across the park beyond the former northwest drive towards the grounds of Ammerdown House, Kilmersdon. Within the grounds a chain of five informal pools lies in a shallow valley about west of the House. The pools are surrounded by mixed specimen trees and shrubberies. A walk on the western side of the pools leads to a kitchen garden southwest of the House.