Wasn't the yellow flag flown on ships to indicate there was infectious disease on board - "the quarantine flag"?
And the song "Tie a yellow ribbon" was in hope that the lover would come back from the war?