When I Was On Horseback refers to the 14th of May. As does The Bonny Black Hare.

---

WHEN I WAS ON HORSEBACK
When I Was on Horseback Steeleye Span    https://www.youtube.com/watch?v=ayYEJX7maQ4

When I was on horseback, wasn't I pretty?
When I was on horseback, wasn't I gay?
Wasn't I pretty when I entered Cork City
And met with my downfall on the fourteenth of May?

THE BONNY BLACK HARE

’ On the fourteenth of May at the dawn of the day
With my gun on my shoulder to the woods I did stray ‘

The Bonny Black Hare · Martin Carthy     https://www.youtube.com/watch?v=yjF1_CxPmHs
Mainly Norfolk :Lyrics and Song Info https://mainlynorfolk.info/lloyd/songs/thebonnyblackhare.html
Alan Burke - The Bonny Black Hare   https://www.youtube.com/watch?v=5pavzvQX_58
The Bonny Black Hare (feat. Dave Swarbrick) · A. L. Lloyd    https://www.youtube.com/watch?v=qsuS7rNTHzU