MtheGM says,

"Where you are going wrong is in failing to appreciate that it is intrinsic skill which is being rewarded in the award of the medals. The total worldwide number of potential contestants from whom the highest achievers emerge is an irrelevance. You might as well say that the government elected by a country with a large population must be more just than that chosen by a smaller total electorate.

~M~ "

Absolute NONSENSE!!!

Do you really think anyone from the tiny elitist group would have what it took to be a champion swimmer or athlete.
Give over!