I think I've bought replacement membranes through Elderly (though only when I had another order as well)
Here's another source: Replacement Kazoo Membranes