I think listening and singing along are fine, but learning to play or make music is better as soon as possible. Otherwise you can end up thinking that only "they" can make music, and your only role is listening, applauding, singing along.
yours, Peter T.