'And can "not making hay" be another phrase for "I wasn't asleep"?'

Not as far as I know. Maybe you're thinking of "not sawing logs"?

Anyone else?