The Swimming Song was written by Kate's ex-husband Loudon Wainwright III.
I read the thread very quickly, so it may have been mentioned, but the wonderful video of The McGarrigles singing Wade Hemsworth's The Log Driver's Waltz plays regularly on CBC TV.

I can see a great read sitting on my bookshelf right now. It's Mountain City Girls by Anna & Jane McGarrigle.