I used to drink coffee all day. Yes, it's addictive, but after a couple days of struggling to stay awake, one gets over it.

I think the beans can be addictive, but you may just like the taste. If they aren't affecting your health, I wouldn't worry.