An internet self-description of him says that his activities include


. . . . . dancing or playing melodeon with the Wild Hunt, playing the Fool, or just being invisible: which role you see him in depends on several factors, all which are still mysterious!

Perhaps he could just use his powers to make himself invisible, then forget how to manifest himself again.