In the version I learned as a kid, it was not drinking but dancing that did it:

"Do you recall the other night, when we were all a-dancing? You gave your hand to the ladies all, and slighted Barbara Allen."

"Yes, I recall the other night, when we were all a-dancing; I gave my hand to the ladies all, and my heart to Barbara Allen."