And that would apply if the electoral college win was only possible because a number of electors had voted "the wrong way"?

I suspect that in such a case it would actually become quite complicated, and that it would end up getting determined by the Supreme Court. It would make a lot of sense for those kind of questions to be determined outside an election context, in a situation where there could be no suggestion that a decision one way or another had a partisan motive.