When anyone attempts to engage me in a negative way about a person who is not present, I usually say, "Have you discussed this problem with them? Perhaps you should" or "You need to speak to them directly." Be very direct.

That usually makes them think twice about approaching you with their bullshit and reminds them that you are a professional.