I think when people say they don't like Jazz as such they are most likely to be thinking of later varieties, the kinds that are revered by people who, more often than not, despise early Jazz.
Terminology becomes a problem - for example "Modern Jazz" for music that is over fifty years old.