You don't say where you live, but in a lot of places, beavers fall under the jurisidiction of the State Wildlife Management office in the department of natural resources. They will help to bring the problem under control--often, there are regulations that dictate what you can do, and when you can do it, and they are the ones who would authorize exceptions when there is an immediate problem--