In February 1827 he was accused of sheep stealing in 1827. From the evidence at the trial it appears that James Williams was a genuine farmer at Big Lagoon but his relationship with Noah Mortimer meant he was often under suspicion. Consequently he cut his ties with Noah Mortimer and moved back to Hobart.