This is complete conjecture based on his songs, but I have always thought Harry fell out with his wife some time in the 60s. He had a song called 'My Old Wife' which I have the sheet music to which extols her virtues. I also have the sheet music to 'My Rattling Old Black Mare' which is a parody on 'MOW' in which he changes the words in the first chorus to 'It's not my wife upon my life, but a rattling old black mare' now extoling the virtues of his horse! Fanny Edwards who he sometimes duetted with must have come into the picture after this. Harry died aged 40 in 72 so his children would have grown up by the time FE emigrated.