On the operating principle of "The simpler explanation is likely to be the true one," I tend to like BobL's button-side explanation better.
Not only simpler, but it would explain the ladies' buttons being
the other way from the men's, which isn't clarified by the sword story.
Dave Oesterreich