Ebbie, not all of the past president's affairs were kept hidden.
There was a rumor that Aaron Burr was screwing his own daughter, and that was the real reason he killed A. Hamilton.

There is no question that Grover Cleveland was the father of a love child. The republicans got a lot of milage out of that but it did them no good, he won anyway. His opponent was a republican named James G. Blaine.
The ditties went.."Hey ma, where's my pa"?(Blaine supporters)

"Gone to the White House, ha ha ha." (Cleveland supporters.)
And,"James G. Blaine, James G. Blaine, the continetal liar from the state of Maine"."

Then, there was Warren G. Harding who was caught "in the act" in a White House closet with a maid.

FDR accused Wendell Willkie of having a mistress when all along it was HE who had the spare!

Jimmy Carter was probably one of the most moral presidents ever, and look where it got him.

There was a rumor on the internet that George was banging Condi Rice, but I think that was just more of the kind of crap that infects the internet these days.