How does it scan any better if you drop the word "you" ?

I have sung this a million times and never had any problem with that line. I would actually find it quite awkward to drop the "you".

Listen to Dougie singing it, that,s the way it goes .