There was no place for religion in Hitler's ideal society.   And some Catholics, like former Chancellor Bruening,--a conservative, by the way-- realized this.

Cornwell:   p 155

In 1933, Bruening "traveled throughout Germany, reading out reports of physical torture inflicted upon Jews and Social Democrats, warning that Hitler's ultimate goal was to destroy the Church."