The Penguin Dictionary of historical slang has the folowing:
skivvy
A maid servant, especially a rough (one). General from around 1905 . Ex SLAVEY.
So it appears to have derived from "slavey", relatively recently. It remains current in Dublin.
Regards