Yes, the words ".... I'll have a dance with the dusty miller ... " or something similar are the ones I'm looking for.

As the words appear to be nonsense, I wonder if they have been made up relatively recently (as the ones used in Shave in Donkey, which I believe were generated by Bampton morris men), perhaps even by Kirkpatrick/Hutchings when they made the Compleat Dancing Master album. The sleeve notes make no mention of the song nor even acknowledge that anyone is singing anything.