Mrzzy,I wouldn't know where to look for the words to confirm this, but I suspect that the song sung by Moustaki which you're referring to is 'Le chant des partisans', also sung by Yves Montand.
I always used to wonder about the fact that the Cohen song made sense. Now that I know he didn't write it, that figures ;o)