Milner was born on 7 November 1849, the second son of William Mordaunt Edward Milner, the fifth baronet and his wife Lady Georgiana Anne Lumley. Milner's father was the Member of Parliament for York between 1848 and 1857. Milner became the 7th baronet in 1880, after the death of his father and his older brother, the 6th baronet, Sir William Mordaunt Milner at the age of 31. Frederick Milner was educated at Eton and Christ Church, Oxford. In 1880, he married Adeline Gertrude Denison, second daughter of William Beckett-Denison, by his wife Hon. Helen Duncombe, daughter of William Duncombe, 2nd Baron Feversham. They had one son, William Frederick Victor Mordaunt Milner, who succeeded to the baronetcy on his father's death. Lady Milner died on 7 July 1902, at the age of 43, predeceasing her husband by 29 years. Frederick Milner died in June 1931 at the age of 81. A secondary school for boys, the Sir Frederick Milner Secondary Modern School in Retford, Nottinghamshire was named after him, although this has now been merged into Retford Oaks Academy.
Family and issue
Frederick Milner, 7th baronet married Adeline Gertrude Denison in 1880. They had three children:
* Lt. Col. John Adrian Hope, 1st Baron Glendevon born 7 Apr 1912, died 18 Jan 1995
* Lady Anne Adeline Hope born 27 Jan 1914
* Lady Joan Isabella Hope born 21 Sep 1915, died 1989
* Lady Doreen Hersey Winifred Hope born 17 Jun 1920, died 22 Jan 1998
Violet Helen Milner - born 7 June 1883 died 28 November 1919, married Lt. Col. Edward York. Had issue:
* Christopher York, born 27 July 1909, died 13 March 1999
* Barbara Adeline York, born 1919, died 1994
Sir William Frederick Victor Mordaunt Milner, 8th baronet - born 2 October 1893 died 19 March 1960 aged 66 and unmarried. No issue.
After the death of the 8th baronet, the baronetcy passed back to the issue of the 4th Baronet. The 4th baronet's second son Henry Beilby William Milner married Charlotte Henrietta Beresford in 1853. He was a JP and lived at West Retford House, Retford, Nottinghamshire but had died long before the baronetcy became vacant. His eldest son Major Edward Milner was also deceased with no issue. His second son Brig Gen George Francis Milner had married Phyllis Mary Lycett Green in 1910 and had two sons with her. His eldest son, Sir George Edward Mordaunt Milner became the 9th baronet in 1960. The ninth baronet married Barbara Audrey Belsham in 1935 with whom he had three children. He relocated his family to South Africa, where the 10th Baronet, Sir Timothy William Lycett Milner, now lives. The current baronet has no children and so upon his death the baronetcy will pass to his younger brother's son, Marcus Charles Mordaunt Miller, his younger brother having predeceased him in 2015.