I've always understood Binnorie to be a contraction of 'By Norham' - Norham being a village some miles inland along the River Tweed from Berwick. There is a castle; and there are (were) mill dams...

For the definitive melody see 'The Northumbrian Minstelsy'.