I always just try to be really polite and deferential so as to never hurt anyone's feelings. For instance:

Whenever I meet a French-speaking person, I always as use Spanish to ask them if they speak English. That way I can always say, "Yeah, me neither" so they don't have to feel so bad if they have to answer "No".