I remember now that Carl Sandburg in one of his books about Abraham Lincoln reports that he played a harmonica. There is a quote something like "Mr. Douglas has a brass band but I make due with this mouth organ."

That dates its presence in the US a little more precicely.

Murray