I understood that the full remark was "God does not throw dice where we cannot see them", and that Einstein was at the time trying to refute the idea of "hidden variables" as an explanation of quantum randomness, but I may have been misinformed. This all rates its own section in the Wikipedia page on hidden-variable theory.