The BBC is reporting that the empty seats are in the blocks allocated to the "Olympic family". At this stage of the games both athletes and officials are probably focussed on their own events and don't have time to spare. As the games go on we will probably see more of them going to support other athletes. In the meantime LOCOG seems to have made arrangements to let others in to use these seats.