"Ain't It A Shame" was used as an encore in Shuffle Along, a 1922 Musical in NYC

LYR ADD: AIN'T IT A SHAME- Four Hamony Kings circa 1922

Ain't it a shame to steal on Sunday
Ain't it a shame to steal on Sunday
Ain't it a shame to steal on Sunday
Ain't it a shame.
Ain't it a shame to steal on Sunday
When you got Monday, Tuesday, and Wednesday,
and you got Thursday, Friday, and Saturday too
Ain't it a shame.

Ain't it a shame to drink hootch on Sunday...

Ain't it a shame to shimmy on Sunday...

Ain't it a shame to steal on Sunday...

-Richie