"down" from Yarmouth to Scarboro' would correspond with railway usage (ie UP is toward London). Though I don't know how long this has been the convention.