It could just be doing 'other' things in the background...like updating or performing some scheduled, automatic task which uses memory.

(I can often see what is using memory by doing ctrl-alt-delete and looking at the list of stuff under 'processes'... most of the numbers will be 0, but a couple might be going from 5 to 95%, showing that something is happening.)