Unless you have identified yourself as a student or tyro, the gentleman's comments are way out of line. I have found it a good rule to never offer unsolicited critisism and, even when I am asked, to never offer critisism. My students expect it. That is what they pay me for. Everyone else, really, wants praise, no matter what they say. This is not to say that I pay no attention to audience reaction. They are my ultimate judge. If they don't like a number or a story or joke, I change it or drop it, altogether. But one, self appointed, expert does not affect me. He gets outvoted by the audience every time.
Once again, if you have been telling people that you are just learning your craft, stop doing that. Just tell your stories as best you can. If you are talented and relaxed, you will be well received.
Have I ever lied to you?