Distilled water I hope. Otherwise you will start to electrolyse it into its components, hydrogen and oxygen - so DON'T SMOKE anywhere near!
Although yes, a warm battery will indeed work better than one that's freezing cold.