I do remember that when Idi Amin was kicking Asians out of Uganda around 1971, there was a hell of a stink when the Asians realised that the British passports they treasured did not give them any right of entry to Britain/England.
Cudgelling memory - were they "B" passports or "D" passports?