Historic Harrisville, New Hampshire, is preserved exactly as it was in the mid-1800s- small brick mills, mill pond, just lovely.
And for a typical New England village with the white clapboard church on the green (and not much else!) my own village of Nelson, NH is lovely. Both are in southwestern NH off the beaten track!