Thanks everyone - It was the first four verses of the original song I was seeking, but I have heard it with the other two bits appended - it might have been "The Yetties" who put them together.

BTW the 92nd psalm goes seems the most appropriate because it contains:

For you have made me glad by your acts, O Lord;
and I shout for joy because of the works of your hands.

Whereas the 93rd starts

The Lord is king; he has put on splendid apparel;
the Lord has put on his apparel and girded himself with strength.

and doesn't seem to contain any lines which would be relevant.