I have Cherries and Plums too, and this song is a favorite on my absolute favorite album. I'll repeat the words here because I'm pretty sure Joe's version contains some errors. (By the way another song is "I'm an Ease Man" -- not sure of the spelling. It means a lazy person.)

Adieu, Madras, Madras adieu.
I can no longer stay with you.
Farewell pleasure, farewell pain.
I'll never see my love again.
For love burned bright when it was new,
But now adieu, Madras adieu.

Madras was just a port of call,
A seaport town in old Bengal.
And I was only passing through.
When love appeared, what could I do.
For love burned bright when it was new,
But now adieu, Madras adieu.

Adieu Madras, Madras adieu.
Farewell old town, I'm leaving you,
And who'll recall within a year
That ever I was standing here,
And I'll be on some far off shore,
No more Madras, no more, no more.
For love burned bright when it was new,
But now adieu, Madras adieu.