I have a similar problem - my specs now have to have prisms in the lenses. Without the prisms, I get a double image, with the 'ghost' image above and to the left of the 'true' image.

My optician says it's pretty common, to do with the alignment of your eyes, and I'd guess it's due to the eye-muscles beng out-of-whack.