It would be hard to beat Edward II and the Red Hot Polkas (they later changed it to something much less interesting).

There was a punk band (from Edinburgh?) called Matt Vinyl and the Decorators.