Not so much difficult to grow as difficult to grow to specs...
even chives and nasturtiums can get insect damaged - but with flowers it's harder to use any kind of insecticide as there is almost *NO* delay between flowering and when you need to process them for sale...
almost all require hand harvest and packageing.
I used chive blossoms in my potato salad this weekend. The heat we've been having I may only have them another week.