And the idea of "by the time" having to do with a completed event or change would explain the "rule" regarding its necessitating the past perfect.