"Even the Founding Fanatics were for freedom of religion, not for imposing their religion on everybody else... that is why they had fled Europe, after all."

Not exactly true. Some of them just wanted to be in the driving seat when it came to persecution, for example of Catholics or even the wrong sort of Proitestrant, such as Quakers.