I am not a fan of our small invaders. The good thing that can be said about having mice is that you almost certainly don't have roaches, shrews or rats. Mice eat roaches, shrews eat mice and rats eat all of them. The answer is still that you should get rid of all of them.