Veteran has a big collection of East Anglian music and song. Look under English and especially albums on the Veteran label itself.

Also (shameless self-promotion warning)
For your East Anglian collection I can't resist pointing you at Fenlandia and Cold Fen which both include a generous helping of songs collected in Cambridgeshire and only recently reconstituted into singable form.

Anahata