The analogy between smoking and vegetarianism isn't quite right, I'm afraid.

What we eat affects us, healthwise, individually. Neither of us will physically affect the other if I eat beef and you eat a nut roast - but both of us will feel the effects of smoking.