Edward and Jane had twelve children. It is believed that Edward and Jane’s family were brought up mainly at Howletts, a 100-acre farm in Shottenden, but partly at Cumberland House, in The Street, Chilham, a Tudor property with seven acres of land. The former is thought to have been in the possession of Edward from the death of his father in 1778, having been in the family for up to two hundred years. The latter had been purchased by Edward’s uncle, John Denne, in 1765, who on his death in 1774 left it to his brother William, Edward’s father; William was living there in when he made his will in 1776, and on his death left it to his widow Mary, with their third son Edward inheriting on her death in April 1785. Edward sold Cumberland House to a Dr Elstead around 1795 and went to live at Howletts.