I think the difficulty for a liberal society, is where specific groups use and abuse social rights and freedoms, in order to *actively* undermine the rights and freedoms of others.

There's nothing wrong in a liberal society and it's laws, reserving the right to be intolerant of intolerance IMO. It's about the only pragmatic response available to such abuse of our rights and freedoms. But there's never going to be a fully satisfactory way to work out the conflict of interests, that doesn't involve either some degree of abuse or hypocrisy.