How about the East Riding of Yorkshire. You'll get a lot of property for your money and some of the finest, undiscovered countryside in England. The music scene is great and the people incredibly welcoming. Not sure about public transport - depends where you go, but it's pretty crap all over the UK.