My UPS used to do that sort of trick a bit when new - there is an on/off button on it which I switch off before turning off at the wall. You see, I often unplug which I will be not using it, especially for a couple of days.