My optical trackball does the same thing occasionally -- slowly creeps upward on the screen all by itself. It's sitting on solid-color mouse pad (even though it's a trackball) so it's not wood grain that's causing it. It's kinda creepy.