There are various clubs and sessions that meet later in the month or week, or stop during the festival season, so unfortunately not happening on the days you've specified. There might be some song or music happening spontaneously at the Square and Compass in Worth Matravers. Sidmouth might actually be the best bet, as suggested above.

Kitty