Kat, maybe you have to disable the Content Advisor, close IE and restart it to have the changes take effect? I'd be worried about removing it, but if you can do it through Control Panel, it shouldn't mess anything up. (Least I think it shouldn't.)