Northerner: No-one who takes the time to offer negative criticism after a performance, is trying to help you in any way whatsoever.
In fact, if the individual has taken the time to let you know that they don't even like "Storytelling" then to me at least, I'd have to say that he's trying to drive you out.
I'd be less polite. Probably interrupt the eejit with something like "Sorry Harry! I have some friends to see right now. Maybe later!" and walk away while his gums are still flapping. Nothing to feel bad about on your part.