She may have been the daughter of Roger Palmer, but Charles accepted her. Charles Fitzroy (1662–1730), created Duke of Southampton (1675), became 2nd Duke of Cleveland (1709) Henry Fitzroy (1663–1690), created Earl of Euston (1672), Duke of Grafton (1675) Charlotte Fitzroy (1664–1717), married Edward Lee, 1st Earl of Lichfield
Grafton is the son of James Oliver Charles FitzRoy, Earl of Euston (1947–2009), and his wife, Lady Clare Amabel Margaret Kerr, one of the daughters of the 12th Marquess of Lothian. His ancestor Henry FitzRoy, 1st Duke of Grafton (1663–1690), was a bastard of King Charles II by his mistress Barbara Villiers.
Major-General Charles Fitzgerald Creagh (1838–1902), South Staffordshire Regiment; General Sir O'Moore Creagh VC GCB GCSI (1848–1923) Major-General Sir Michael O'Moore Creagh KBE (1892–1970) General Sir Timothy Creasey; Brigadier David Hector Craig Creswell; Brigadier Wilson Theodore Oliver Crewdson; General John Crewe, 2nd Baron Crewe
Augustus Henry FitzRoy, 3rd Duke of Grafton, KG, PC (28 September 1735 – 14 March 1811), styled Earl of Euston between 1747 and 1757, was a British Whig statesman of the Georgian era. He is one of a handful of dukes who have served as prime minister .
James Oliver Charles FitzRoy, Earl of Euston (13 December 1947 – 1 October 2009), married Lady Clare Amabel Margaret Kerr, daughter of the 12th Marquess of Lothian, and had issue, one son, Henry FitzRoy, 12th Duke of Grafton, and four daughters. Lady Henrietta Fortune Doreen FitzRoy (born 14 September 1949), who married Edward St. George.
James Oliver Charles FitzRoy, Earl of Euston (1947–2009), eldest son of the 11th Duke, predeceased his father in 2009; Henry Oliver Charles FitzRoy, 12th Duke of Grafton (b. 1978), only son of Lord Euston; The heir apparent is the present holder's son, Alfred James Charles FitzRoy, Earl of Euston (b. 2012).
Fitzroy, Augustus Henry, (1735-1811), 3rd Duke of Grafton, statesman; Fitzroy, George Henry, (1760-1844), 4th Duke of Grafton; FitzRoy, Robert, (1805-1865), MP, Governor of New Zealand, Vice Admiral and meteorologist; Flahaut de la Billardierre, Auguste Charles Joseph, (1785-1870), Comte De Flahaut de la Billardierre, French General and diplomat