But a lot of Brexiteers seem to believe where we seem to be heading is as bad if not worse than losing.

I see no evidence of that at all, unless you mean those who fear we are heading for a soft Brexit instead of what we voted for.