Not sure where the 'Many's the mile from off your sway' came from but I have always known it as many's the mile from off your swain....... a swain being a young lover. Sway does not seem to make sense.