I pay my annual "panhandler tax" - a donation to the Salvation Army. I don't feel guilty at all when I pass them by - they all know where the soup kitchens and the missions are if they are desperate.
When he sees a panhandler with a dog, a friend of mine has been known to give them a can of dog food. :-)