Pete, the sun is not thought to be "diminishing ever since."
It is believed to be getting steadily hotter.
I think the "faint sun paradox" you refer to relates to that, and why the earth was not permanently frozen earlier.