Definitely has rugby connotations for me - I learnt it in the army reserve in the late 1960s, but from a guy who used to hang out with a rugby crowd, before then it wasn't part of the classic army repertoire.
I would surmise that the specific England association arose in the era when forward domination became the hallmark of their game (what swings low on a bull?)