"He wants to put an axe to the corruption of capitalism." So he doesn't want to put an axe to the 'dirty old town'; that last verse has no connection with the rest of the song or the refrain (need I remind you: "I'll chop you down, like an old dead tree,/Dirty Old Town, Dirty Old Town")?