I don't know 'Ginny on the Moor' but in the broken token songs the girl doesn't recognise her lover because they were very young when betrothed. A boy back from years at wars or from the sea would have matured and grown and may even be scarred so would be hard to recognise even if the girl had had a photograph to remind her what he looked like.