The song was written, I think, by Frank Stokes. It was recorded by him in 1927. "Mr. Crump" was Edward H. Crump, mayor of Memphis around 1910. Supposedly, he was a reformer who had the support of the Beale Street musicians of the time. After he was elected the first place he reformed was Beale Street, prompting the song.

The lyircs you have look correct but there are one or two more verses. I don't have the words but you can find the song on the Yazoo CD, "Frank Stokes Creater of the Memphis Blues"