Haven't got a link for this, but I heard that the origin of the phrase was an aristocratic lady who got a new chauffeur. His name was James Darling. When it came to hometime, she chose to say, "Home, James," for some reason. :-)