I suspect the phrase has been used in a lot of gospel songs. I wrote a song, When I Get To Glory, with the opening verse:

   "It's a long and a lonesome journey
    On a rough and a rocky road
    It's not made for the weak or the faint of heart
    You've got to carry such a heavy load."

Jerry