Urethane foam is used for thermal insulation and should make fairly reasonable sound insulation. It's cheap enough to buy a few sheets and give it a try - 2 inches thick is readily available and you might even be able to get some that's thicker.

It is very light so that a portable modular building would be quite feasable, even if you had to sandwich it between thin plywood for durability.