Not necessarily, Rhiannon. There are lots of reasons given for us Lincolnshire-ites being called yellow-bellies, of which the waiscoat-thing is one, but there doesn't seem to be an absolute definitive answer.
But the waistcoat's as good as any!
Johnny :0)