Some people say that it is antisemitism but not everyone agrees.

Since the UK is one of the member countries that adopted the definition I would say that anyone expressing those views in the UK is committing an act of anti-Semitism regardless the prejudice of individuals who refuse to accept it.