Hugill reports it both as "Doodle let me go" & Do let me go". I find it pretty close to "Dou Dou" a West Indian term for a women (though I've always sung it as doodle), Yella Gal, could there be a corruption here. Barry