The duty of courtesy towards others is generally more important than exercising our right of free speech in a way that offends against this duty.

I think that is the size of it.

And our duty of courtesy towards others includes not being quick to take offence where offence is not intended.