Whenever I see someone cleaning up after their dog, I generally make a point of going over and thanking them.

It usually cheers them up to hear it as much as it cheers me up to see it.