Ellenpoly, i am sure he did not mean harm by his remark. Back then things were simpler. Mr grandad used to call his shipmate 'darky' but his darker friend used to call him 'whitey'.
These were the days before Political Correctness became the new fascism and criminalized words.