He may keep on doing this because he does get a reaction. I think I would try the not making an issue and installing a cat door or flap. Out of interest does he ever have contact with the other cats at any time, do they get along or just tolerate each other?