Here's how I transcribed it from Jim Kweskin and the Jug Band.

Rag Mama

I'm goin' down town with my hat in my hand
Looking for a woman ain't got no man
Might as well be looking for a needle in the sand
Looking for a woman ain't got no man

Well, dee dee dum deele de dum Rag Mama
Come on baby let's do that rag

Now, you get one woman you better get two
One for your buddy and one for you
You better get a wife and a sweet heart too
Wife don't love you but the sweet heart do

Chorus ...

I never thought my gal would treat me so
Love her many and I'm out that door
Now come on Mama what you know
You're gonna reap just what you sow

Chorus ...

Say my gal with a man she as holding his hand
Had a pistol in my pocket black jack in my bag
Run outside with a half a brick
Sayin' I'm gonna get that so-and-so

Chorus ...

Scat verse to end
Rag Mama, come on baby let's do that rag.