He sounds like a homophobic and bitter person Joe. You handled it well, but shouldn't have had to put up with that.
Here in UK it would have come under misconduct and harassment in the workplace. Also, homophobic remarks are regarded as a crime and the perpetrator can be prosecuted if, as you said, there are witnesses.
It was more than a 'misdemeanour' and not sexual since it involved words not sexual actions.