I've had a quick look in Burkes Peerage again. I can't see any of the Dukes of Grafton who drowned. The song mentions Woburn Abbey which certainly is the home of the Duke of Bedford.
Very strange. Perhaps it should be someone entirly different.