"...before they were "invaded" (wich is bullshit, in a way, but that's an entirely different discussion)."

In the same way that referring to "the Saxon invasion of Britain" would be "bullshit", gnu? In itself it's a fairly neutral term. One set of people move in and take over a place where another set of people had been living, in face of opposition.