Having been hot air ballooning it is a wonderful experience, however the pilot has to be incredibly spacially aware because it takes quite a time for the balloon to respond in the vertical plane - a balloon with this many on board would have a lot of inertia too and only respond slowly.

So sad, my condolences to all involved.