It does not have to be session members. On more than one occasion I have found that members of the public seem to think you are a band without a leader, and proceed to take charge.
The mildest form is constant requests for Drowsy Maggie, even when it has been played and they did not notice. To one lady who conducted and told individual players when it was time she considered they should start tunes.