Not actually having a belief that there is a God isn't atheism, it's agnosticism. Atheism is definitely believing there is no God.

I don't believe there is anyone at my front door right now. But that's just a provisional belief that could be dispelled by a ring of the doorbell.