The dictionary definition of a semite is

1. a person regarded as descended from Shem.

2. a member of any of the peoples speaking a Semitic language, including Hebrews, Arabs, Assyrians, Phoenicians etc.

3. same as Jew: a loose usage

Maybe if the term was 'anti-Jewish', which is what is being talked about here, people might think a little more carefully before discussing this subject.