His ancestor, Charles Boileau (1673-1733) fled to England on the revocation of the Edict of Nantes by Louis XIV in 1685 to the Brandenburg Musketeers and thence to England in 1691. In the lifetime of his father surrendered his right to family title and property in favour of his brother Maurice.