...with "tae the broom" glossed as "make love"

There's a phrase, not used so much now: "living over the broom" or "over the brush" with someone, meaning living as man and wife without being married. Same origin?