I think "socialist" in this context just means "I don't like him", the same way that "Liberal" does.

I know in other contexts it means people who believe it's necessary to take banks into public ownership, but that definition wouldn't apply these days...