Well, even easier, I found that if have the cursor at the beginning of my document, whether there is text in it or not, I can click on Insert then Header and start my header that way. It seems to default to every page.

Are you by chance using a template that has its own formatting attributes?