"But if a chap in long baggy shorts, socks and sandals driving an ageing Vauxhall Corsa appeared, trailing BO and with yellow teeth, people wouldn't say anything at all."

Depends where it is of course. If your guy in baggy shorts, socks and sandals turned up at the expensive casino in Shanghai ( ie where Bond nearly has a run in with a kimono lizard in the new film) then your guy might not only be very noticed but he probably wouldn't even be let in! The rest of the characters were in expensive suits etc so Bond blended in.