There are no "baddies" in the song, just people who have to make choices.
Matty/Musgrave has to choose whether or not to try his luck with the lady.
She has to choose whether or not to invite him back to her place.
The page has to choose ... and so on.
Thankfully they all make what turn out to be the wrong choices. If they didn't it would be an extremely boring song! In fact it would have been forgotten long before now.