There are devices that you plug into an outlet that emit high-frequency squeaks which repel pests but not humans. I have two in my home, and they seem to help.

It's a bad idea to let a cat eat mice. Mice carry the eggs for tapeworms, which then infect the cat. I have had to have three cats treated for tapeworms. Now my cats are indoor cats.

In some places, mice can carry a virus, the hanta virus, which can kill you. In addition, they are filthy and can chew on your wiring, starting a fire. It's such fun, too, to reach for a clean dish towel and discover that they've been pooping on them.

Get some traps, and when a mouse is caught, throw it away, trap and all. To balance your karma, send some money to a deserving cause, such as children in Africa. There are 10,000,000 motherless children in Africa.