It would be anti-semitic to claim that Holocaust Day does not commemorate non-Jewish victims, implying Jews do not care about any suffering but theirs.
That is one of the things Walker did.