Yes. I agree with Paul that the song could actually be in G, though it begins with E major and ends with E major, and there isn't even a G chord used in all its main verses.
I've posted the chords to the song on my website a while back:
E C E
I don't want your pardon, don't want your amnesty.
C D E
Don't you smile with Christian sympathizing.
C E
Don't you tell me you're forgiving me.
C D E
I am doing no apologizing.
To listen to the song, click here.
Jason