I've always sung it as

"Do you let me go"

an 18th century variant of "will you let go" or "please let go" of which I suppose doodle may be a contraction