I spent decades working outside the EU with no problems. If the EU wishes to insist on visas we can easily reciprocate.
https://en.wikipedia.org/wiki/Visa_policy_of_the_United_Kingdom