I think that if it's a choice between the listener asking for change or not giving anything to the performer, that it is better that they ask for change... the rest of the money may in fact be spoken for already. You never know.

But people going into the case for change without even asking is a total no-no.