From the ambience of the song I always imagined that it was the fine woollen cloth called cashmere that was referred to, not the Indian state of Kashmir. It made more sense!

Looking at the preceding line, it makes even more sense if it's a flower. However, I can find no reference to a flower called cashmere or kashmir. Could it be a mis-hearing of catsear?