When you consider that Smirki Patel was forced to step down after fixing clandestine and unauthorised meetings with Israeli ministers when she was purportedly on holiday, it would hardly be surprising if intelligence agencies felt that they couldn't trust her.