Here's a peeve of mine: categorically, as in "I categorically deny that I broke the windows."

What is it supposed to mean? I believe the speaker wants to convey "emphatically" or "without a doubt," because how do categories enter into it?