Yes, I would. Some of these comedy club audiences can be vicious and deserve whatever they get. If their attack was foul mouthed and racial, they were getting tit for tat.
If Richards went racial first, then he owes an apology.
No one has yet said what exactly triggered his tirade.