(I don't believe I am having this conversation.)

You only need to turn out of the tangent if the reference (your weird planet) remains stationary which it can't.   Hence what appears straight is at least logarithmic which of course describes a parabolic trajectory.

(Shit. I'm slipping, need to check I have a name badge or I'll not be allowed out. .. (