Two erudite discussions on the origins of this phrase can be found at Snopes and at Word Origins. Neither discussion is definitive, but both trace the phrase back to the nineteenth centruy.

A