Not just Jews, and not enemies of Labour.
The Mirror today,
"Top Labour figures have admitted the anti-Semitism row hurt the party's chances in the local elections.
The party was widely tipped to take Barnet which has the highest proportion of Jewish residents of any borough in Britain but defeated councillors and activists blamed .

Barry Rawlings, Head of Barnet's Labour group, said the party lost because "so many of our neighbours believe we tolerate anti-Semitism".
He told the Guardian: "What happened instead was an election day phenomenon that I never want to experience again. Jewish residents voted in protest against Labour."
ur."
'Labour lost Barnet because Jews that had previously voted for them could no longer do so'
https://www.mirror.co.uk/news/politics/top-labour-figures-admit-anti-12491525