If I go to a session, it's not solely for the purpose of playing music. To me music is a deeply social thing.The thing is though, that the people I want to talk to are the people that I want to play with.
Others are effectively "the audience". They get the chance to witness musicians playing live in an informal environment. If they don't give their respect, they lose their privileges.
I used to play in O'Donoghues Pub in Dublin about nine years ago. The session was wicked i.e. the musicians were enthusiastic, encouraging and enjoyed playing together. They were also hilarious fun to talk to during the "in between" bits. The problem with O'Donoghues though is that it is usually rammed to the rafters with loud drunken punters who are attracted by its reputation.
When they got too loud, someone would simply stand up and yell "SHUT UP!". It has a remarkable effect once followed with a simple explanation.
It's a matter of mutual respect. If that isn't there, then move to another pub with those musicians who agree with you.