Well it does not sound like a conflict to me.
Are you sure you are plugging into the same port each time? I don't understand the set up but do know that if I plug the same device in a different port, it becomes a "new device" and Windows is stupid enough even to ask for drivers that it already has installed.