Carpenter was the only surviving son of George Carpenter, 2nd Baron Carpenter by Elizabeth, of Ocle Pychard, Herefordshire, England. This nobleman married in March 1747/1748, Frances, the only daughter and heiress of Sir Robert Clifton, 5th Baronet, of Clifton, county of Nottingham, England and heiress of her mother, Lady Frances Coote, only daughter of Nanfan Coote, 2nd Earl of Bellamont. They had six children;
Lord Carpenter's Arms appear to be of French or Norman heritage, "Paly of six, argent and gules, on a chevron azure, 3 cross crosslets or." Crest, on a wreath a globe in a frame all or. Supporters, two horses, party-perfess, embattled argent and gules. Motto: "Per Acuta Belli". These arms descend from John Carpenter, the younger who was the noted Town Clerk of London during the reigns of King Henry V & King Henry VI. These Arms are often referred to as the Hereford Arms, named for the later ancestral home of the Carpenter Family in Hereford, England. The Crest, supporters & motto apparently has changed several times over the centuries. Sir William Boyd Carpenter, an English clergyman of the Established church of England, Bishop of Ripon, afterwards a Canon of Westminster and Chaplain to the reigning sovereign of England, wrote in a letter dated 7 August 1907 that his family bore the Hereford Arms. Sir Noel Paton, upon painting the Family Arms, informed him that the supporters were originally a round-handled sword, which in drawing over time became shortened, until nothing but the cross and globe were left beneath it. Those Hereford Arms were used by "John Carpenter, town clerk of London, who died 1442 A. D." His grandson John Boyd-Carpenter, Baron Boyd-Carpenter, continued the Arms into the new century by passing it down to his son, Thomas Boyd-Carpenter, who was himself knighted after a military career as a Lieutenant-General and for public service. There is no direct male to male Carpenter descent connecting Lord Carpenter and Sir William Boyd Carpenter. The family connection is by marriage through the females in the family. The Hereford Coat of Arms described above should not be confused with the Arms of Bishop Richard Carpenter presented in the "Visitations of the County of Oxford taken in 1566, 1574, and 1634", published in 1871, which describe the arms displayed in the buildings at the University in Oxford – "In the Lyberarye of Baliall College" – as recorded by the officials performing the visitations in those years. The Visitations describe the arms of Richard Carpenter as: "Paly of nine Gu. and Az. on a chevron Arg. surmounted by a mitre Or, three cross crosslets of—nine pales alternating red and blue, with a silver chevron bearing three gold cross-crosslets.
