I suspect it was John Denver who changed it to "old gray men".
That seems to be the way it is usually sung in the PC World.
Not in this John Denver version (click), but he does uses "grey" and other altered lyrics in this 1971 version on the Aerie album. -Joe Offer-