Charlotte Lee was born Charlotte Fitzroy, on 5 September 1664, the fourth child and second daughter of Barbara Palmer, Countess of Castlemaine, the only child of the Royalist commander William Villiers, 2nd Viscount Grandison. She was placed in the care of a governess in Berkshire House. Charlotte Fitzroy's mother had separated from her husband Roger Palmer, 1st Earl of Castlemaine, but was still married to him. Castlemaine did not father any of his wife's children; Charlotte and her siblings were the illegitimate offspring of their mother's royal lover, Charles II. The king acknowledged his daughter and so she bore the surname of Fitzroy – "child of the King". The diarist Samuel Pepys noted that the child would likely have good marriage prospects: "my Lady Castlemayne will in merriment say that her daughter will be the first mayde in the Court that will be married…" Charlotte was the favourite niece of James, Duke of York, younger brother of Charles II, who would later reign as King James II. The historian John Heneage Jesse wrote of Charlotte Fitzroy: "we know but little of her except that she was beautiful." As a child, Charlotte was painted by the court painter Sir Peter Lely, Charles II's Principal Painter in Ordinary, in which she is seated with her Indian page, holding a bunch of grapes and dressed in pink silk. Today, the painting hangs in the York Art Gallery. The art historian Anna Brownell Jameson described Charlotte Fitzroy as having "rivaled her mother in beauty, but was far unlike her in every other respect." It appears that Charles II was a loving father. In 1682 he wrote to Charlotte: "I must tell you I am glad to hear you are with child, and I hope to see you here before it be long, that I may have the satisfaction myself of telling you how much I love you, and how truly I am your kind father, Charles Rex".
Marriage and children
On 16 May 1674, before her tenth birthday, Lady Charlotte was contracted to marry Sir Edward Lee, and they were married on 6 February 1677, in her thirteenth year. When Charles Stewart, 6th Duke of Lennox, died in 1673, Sir Edward was created Earl of Lichfield. Charlotte's dowry was agreed at £18,000, and her husband was awarded a pension of £2,000 per year. Together they had eighteen children:
Charlotte Lee died on 17 February 1718, aged 53, and was buried in All Saints Churchyard in Spelsbury, Oxfordshire, England. A building was constructed right next to her house that would eventually be known as 10 Downing Street.
