Were I live in southeastern NH, there is a lot of music. Naemanson listed festivals, but if you don't mind a little traveling (an hour to some) it's possible to go to a session just about every night of the week. Boston is a little over an hour away, and Seacoast NH (Portsmouth) is about a 40-minute drive. Where I live there are lakes and mountains closeby, small towns with an old-town feel, farms, people who live in cabins in the woods, tourists, lobster, lighthouses up towards Maine, old graveyards and gorgeous dirt roads with firey autumn foliage.I lived in Delaware before I moved here. It wouldn't have been bad to stay there. It was a lot less expensive than where I am now, and there was a growing folk community. Where I lived (Dover) it's rural, but close to Washington DC and Philadelphia. Wilmington, DE had a few folk clubs. I really miss the Amish store I used to frequent.
The DC area has probably got the largest concentration of serious folkies in the US. It's fairly expensive to live there, but probably easier to find a better-paying job. Outside of DC in northern Virginia and Maryland, there are loads of rural areas.
I've lived in Indana too - don't ask. (I may have just had bad luck finding music and it was a while ago, so things may have changed.)