Applied to Americans by Americans, "Tory" is still under the taint of its use in the War of Independence as a somewhat pejorative synonym of "Loyalist", i.e. "one who advocates remaining under the King of England". Other connotations are not unheard of (e.g. when I was at Yale there was a "Tory Party" in the Political Union, and while ultraconservative, it wasn't pro-British particularly), but rare.
Liland