DaveO's vesion is the one I remember as a kid as well, only with these differences
Little red caboose
Chug chug chug
Little red caboose
Chug chug chug
Little red caboose behind the train train train train
Goin' down the track track track track
Smoke stack on the back back back back
Litlle red caboose behind the train.