One explanation I've seen: pigeons can't process moving visual fields very well. So they keep their heads still relative to the ground while walking, then jerk them forward as fast as possible so they catch up with the rest of the pigeon.