Rip out the capslock key? Seems drastic...

I have a program called FirstCap which allows me to control the functions. It is set to NOT allow the capslock to be turned on. Instead, I must manually hold down the shift key whenever I want to enter a Cap...and I must continue to hold it down if I want a SERIES of caps.

It gives a tiny 'beep' if I hit the capslock, just to remind me of what is set.

It can be set for various modes, depending on your needs or attitude.