Daylia...that place under your shingles is a natural home for hornets, wasps, bees, yellowjackets. If one lot leave, another lot are quite likely to move in in short order. I strongly suggest you hire your local handyman to spray some insecticide in, and then plug up those holes.