Jewelry has had talismanic significance throughout history. It has been worn for both power and protection. (Witness "Lord of the Rings.") Perhaps on a subliminal level you feel attached to yours and loath to take it off for such reasons. Or maybe it is a vital part of the identity you project to the world. Either way, or both ways, it doesn't seem weird that you wouldn't want to take it off.

Although it won't solve the identity issue, it might help the talisman aspect to wear it in a little pouch around your neck or in your pocket or elsewhere on your body so that you don't feel separated from it. Just a thought.

Elmer