Two good answers already from Howard and Ged.
You really don't need to hang out with people like that, so walking away from the session was no great loss.

One of the things that always comes back to me when session etiquette is discussed on Mudcat is that ALL SESSIONS ARE DIFFERENT! A really good one that suits your own musical style and has nice friendly people in it is a good thing to find, but there's no guarantee it will happen where and when you want it to. That's part of the magic of a really good session - it's so lucky when it happens at all.

Anahata