I just can't imagine many Irish Americans would appreciate being called "Anglo-Americans".

It's bit like the way WASP sometimes seems to get used to refer to people who might be "white", but are neither Anglo-saxons nor Protestants.