That's true. During the Ebola outbreaks abroad, people round here were a bit wary in case my husband was carrying it! (There was only one confirmed case in Ivory Coast, but of course he does travel on flights to Abidjan, and on board may be Africans from several countries)
As he's 'the only black man in the village'(apologies to Little Britain) I suppose it was natural for them to be a bit concerned.

All I do (to avoid catching flu etc) is to wash my hands thoroughly once I get home from an outing to the supermarket. One can't creep about in life being fearful of dying of some awful disease.