Add to that that a 20000 year orbit isn't far off the 25000 or so year shift in the background stars (from here) because of the precession of the equinoxes. Planet's etymology is wanderer; and it doesn't wander much. So it could actually be hidden in plain sight (with a big telescope).