I thought the Speaker of the House followed the VP.

Only if a new VP hasn't yet been confirmed as per the provisions of Amendment 25. For the Speaker to be elevated to the Presidency, both the President and Vice President would have to die, resign, or be incapacitated within a matter weeks, at most. Once the vacancy in the VP spot is filled, the Speaker goes back to being #3.