As long as the phones aren't making noise, I wouldn't be bothered.
The screen on an iphone or similar is very bright and distracting if the lights are down in a venue.

Why people pay good money for a gig and then sit there playing with their phone is beyond me, maybe folk gigs should be more expensive so people appreciate them more.