I see it as a night visiting song with an emotional take rather than a narrative take. To me the rider is a man and the singer is a woman constrained by duty, race, custom, family, W.H.Y.