Howard had a long affair with the estranged wife of John Villiers, 1st Viscount Purbeck. She was Frances Villiers, the daughter of Sir Edward Coke and his second wife Elizabeth Hatton, and it was said she had been forced into the marriage at the age of sixteen with John, who was the brother of the royal favourite George Villiers, the Duke of Buckingham. John was generally believed to be insane, and the marriage had taken place over vehement objections from her mother. The result of the affair was a son born in October 1624 at Cripplegate who was initially called Robert Wright, but who would go on to take the name of Villiers and was finally known as Robert Danvers. Frances's brother-in-law the Duke of Buckingham had the pair brought before the Star Chamber on charges of adultery. Frances Villiers was found guilty. Howard was made a prisoner of the Fleet prison and excommunicated for refusing to answer questions at the trial. Frances, Lady Purbeck, was fined and sentenced to a term of imprisonment, and to do penance – but she fled abroad. Eventually she returned to England and reputedly set up house again with Howard, with the result that there were more children. In 1635, Howard was again summoned before the Star Chamber to answer for the resumed scandalous affair. He refused to answer as to the whereabouts of Frances and was kept for three months at the Fleet , and he had to surrender bonds as surety that he would not again contact Frances and that he would appear again at the Star Chamber within 24 hours of being summoned.
Parliamentarian
In 1623, Howard became a member of parliament for Bishops Castle in Shropshire and was chosen again at many subsequent elections, including the two during 1640 for the Short and Long parliaments. During the second, the Star Chamber made adverse findings with regard to Howard, but they were deemed unlawful and all of those involved were fined, with Howard receiving one thousand pounds in compensation.
Royalist
Howard's credentials as a royalist had been laid in 1616. At the investiture of Prince Charles as Prince of Wales on 4 November, both Robert and his brother William were made Knights of the Bath. Howard had to leave the House of Commons in 1642 after killing the king's commissioner of array, but he did attend the session of parliament held at Oxford in 1641. Howard is said to have led a regiment of dragoons and was in charge of Bridgnorth Castle when it was surrendered to the Parliamentarians in 1646. The three-week siege left the castle tower leaning more than the Tower of Pisa. Howard was again fined. This time he had to pay 952 pounds to recover the lands that were sequestered in punishment. In 1648, Howard finally married. He married Catherine Nevill, a daughter of Henry Nevill, 9th Baron Bergavenny and his second wife Catherine Vaux, and they had three children. Howard died on 22 April 1653 at the Hall in the Forest and was buried at Clun, after which his wife remarried John Berry A brass plaque in St George's church in Clun, stating his age as 63, commemorated Robert Howard's life.
Danvers
Howard's illegitimate son Robert was recognised by his mother's husband as his son and heir. He in time might have become Robert Villiers, 2nd Viscount Purbeck, but after the first Lord Purbeck's death on 18 February 1657 Robert laid no claim to the title, which in 1678 was denied him by the House of Lords on the grounds that he was illegitimate. Deprived of the name Villiers, Robert took the name of his wife and became known as Robert Danvers.