The last man to be hung at Bury St Edmunds has a memorial in the Nave of Great Livermere St Peter's [Arundel Coke] 1722 entry
http://www.stedmundsbury.gov.uk/sebc/visit/1700-1899.cfm
In St Bartholomew's Churchyard at Groton has the oldest gravestone in Suffolk which is dd 1598