If someone is in my neighbourhood and looks as if they are lost, I might ask them if I could help them. I would never dream of saying "What are you doing here?" I would see that as remarkably aggressive bad manners. It would invite a hostile response.