My own pet theory is this. In days gone by, people became betrothed, and it was the done thing to offer your hand in marriage. Therefore if you decide to marry someone else instead, it could be said to be 'married out of hand' i.e, not marrying the person that offered their hand, but someone else.

Just my own thoughts on the matter, for what it's worth.