Well, initially the word "legend" comes from a medieval genre of narrative that we now call the "Saint's Life." I would guess that calling people "legendary" means that they are to music what a saint is to religion: people who fulfill the highest ideals of musical life.

Alternately, "legendary" may refer to musicians who are not only important, but about whom there are lots of cool stories.