Sounds like Cody chose your brother as his Person.
He found the place the first time..he'll surely come back when he's done being freaked out by folks tramping around scaring him by saying his name.

Kitties are pretty good at finding their way back home and if Cody's mind was set on running that bullycat away, he was going to do it. When he comes home, at least the cranky outside visitor probably won't be coming back to hassle him anymore.