I believe that the first record to be banned by BBC Radio was Tom Lehrer's Masochism Tango/Poisoning Pigeons in the Park.

I've also heard that Leon Rosselson's Little Tim Maguire was banned because it might encourage arsonists.