Whitby FF jumps out under such description. It is far from being a small festival, but it's held in a small, beautiful place, and you can dip in and out of the wall to wall music whenever you want to.

Unfortunately most small festivals are more concerned with bums on seats rather than singarounds and sessions. The few that cater mainly for traditional music soon get booked up.