The one that I was thinking of had the chorus

With me deerstalker hat & me fol di rideree dee
I was the lover of Lady Chatterley.

I've come across it in a song book which jogged my memory but I've no idea as to who wrote or originally recorded it.