Done well, and at apropriate volume, percussion of most kinds (sorry, no spoons) can enhance many a session.

I suspect that hostility is frequently aroused by people who assume that because such instruments are often given to children there is no skill required to play them. The belief that everyone should join in can have horrid results when a lack of sense of rhythm is coupled to enthusiasm and a loud percussion instrument.

On the whole I'd say practise first at home, and when you do start to join others be prepared to judge their response and adjust accordingly.