"You might as well say that musicians only care about notes and chords because the make the final piece of music."

I might say that but I didn't. Storytellers use characters to make stories. Songwriters use notes and chords to make songs. Carpenters use nails and boards to make their projects. Musicians care about making music, notes and chords are just the materials.