Those words, hard times, also occur in Stephen Foster's song, My Old Kentucky Home, Good Night found in the DT here.

I won't say it's a prerequisite for being a Kentuckian, but we all know the words!

By 'n by hard times come a-knocking at the door
Then my old Kentucky home good night...