Archie Fisher recorded this on 'Will Ye Gang Love' (Topic), not 'The Man with a Rhyme'. The text that Fisher sings is very different from that posted above. For example, the first 2 stanzas go:

As I was on my rambles, I came from Dover to Carlisle
The town was full of rebels and you might have heard them for a mile
I stepped in The Grapes (?) to see what entertainment I could find
Not being brisk, I ran the risk and I called for a pint of wine
And spied a handsome bonnie lass, the flower of France and England

I'd been in a hurry, I for a private room did call
They sent me to the caddie, the lad that rings the morning bell
But in there came this brisk young dame, she said kind sir come follow me
It is not fit for you to sit among such rovin' company
My handsome, bonnie, smilin' lad, the flower of France and England