Oxford shows examples of "ouster" ('dismissal or expulsion') from 1531.

It is, in fact, the original meaning.

"Ouster" ('one who ousts') is recorded only since 1869.

And "ousting" as a noun doesn't appear till the 1850s.

Which is now quite a while ago, actually.