If you didn't use punctuation in your music, it would sound pretty meaningless and nobody would bother to listen to you. Oddly enough, the same is true of prose. I'm sure that you wouldn't insult your (musical) audience by playing incoherent music. The same courtesy extended to your (prose) audience would certainly help us to understand what you are trying to say.

Music and speech -whether heard or physically represented- both require the same disciplines of expression in order to make them coherent and meaningful. Neither is more important than the other; they are, essentially, the same thing.