There's a big difference being violent protest and peaceful protest. And there are situations where a particular expression of "free speech" can be reasonably criticised as inappropriate and potentially damaging. The classical example is of shouting "FIRE" in a crowded theatre.