It depends.

When I sing an unaccompanied ballad I go still and close my eyes. I want to focus. If I do it right it will have a pulse, but not a beat.

Otherwise, I move. Rarely tap my feet, though. Too distracting for me.