Stories, maybe. Take away the music, and they are still there.
I suspect that the rationale for being against music would be that it is such a powerful thing that it ought to be reserved for special occasions. As I understand it tbe Taliban weren't against some types of religious music, and I know that there are some Christian traditions that don't allow secular music, but do allow particular styles of hymns.
My impression is that being against music and against alcohol tends to come hand-in-hand, with some religious traditions. And vice versa. I'm vice versa myself.