Ebbie, I have always heard it as, "Since Heck was a pup." I found a reference to its use in that form by Sinclair Lewis in "Babbitt" written in 1922 (see line 60.) I always assumed it was a euphemism for the Devil; but I can't say for certain.