Most of the "pros" work the music first and the lyrics second. However, I say do whatever works for you. If it's harder, but yields better results, go for it.