The connection is the chorus; Byron borrowed a couple of lines. The songs are otherwise unrelated. Planxty recorded an arrangement of a Scottish set of The Jolly Beggar (Child 279) if I remember correctly.

The subject has come up a number of times in the past; see, for example Lyr Req: And we'll gang nae mair a roving