Geogiansilver, it may be that the boatmen were handsome because they were so fit, which is surely a component of attractiveness.

According to the novel I just finished ('London', by Edward Rutherford) the Thames boatmen were hired by early insurance companies as firemen, for just that reason.
Interesting book, thought-provoking and enlightening.