James Webster was born in 1759 in Norfolk, England. He married Charlotte Holland on September 4, 1775, in Attleborough, Norfolk, England. They had six children in 12 years. He died on May 14, 1823, in Great Ellingham, Norfolk, England, at the age of 64, and was buried there.