I think it means 'a great sadness quickly arrived'. A bit literal I suppose, but having lived that song at least once on both sides of the question its rather amazing how the loss of love drops your precipitously into dispair. Clearly John Prine knew.