Getting back to those many common expressions people use (but don't actually mean)....

My Father's favorite expression when under stress was "Bloody hell!!!"

His favorite expression when astonished was "Jesus!" or "Jesus Christ!"

My father was also a total, absolute, 100% atheist. He didn't believe in God. He didn't believe in Jesus. He didn't believe in hell. ;-) If you had questioned his use of the above terms and complained about it offending your sense of logic regarding religious beliefs or non-beliefs thereof, he would have given you an annoyed look and probably have made some sarcastic comment indicating that he thought you were a stupid prat and a pest to boot.

The fact is, my Father said the various things he said like that in a completely unconscious manner, and they had nothing to do with his beliefs in God or in anything else. They had to do with the unconscious habits of speech he had acquired growing up in the culture of his time.

He did not appreciate anyone's efforts to analyze his unconscious behaviour and bring it to his attention, since he was a law unto himself.... ;-)

As most people also clearly imagine they are a law unto themselves, I suggest that you leave them alone to say whatever makes them happy, whether or not it makes any logical sense to you or bothers some knee-jerk personal hangup of yours. They'll probably like you (somewhat) better if you mind your own "goddamn" business and let them talk in whatever way they naturally choose to.