Hmmm, well, as a female who loves singing this song, I don't have any issue with the "men" bit, and wouldn't see any need to change the words. Nor would I change gender in other songs that are so-called "men's songs": if it's a good song, just sing it!