Donuel you make a very valid point. It is likely climate change has collapsed many societies or at the least severely stressed them.
https://nsidc.org/sites/nsidc.org/files/files/NRCabruptcc.pdf

1) the dark ages
https://www.atmos.washington.edu/2001Q2/211/groupE/andy.html (some interesting ideas)

2)The collapse of the Anasazi peoples of the American Southwest
https://www.scientificamerican.com/article/climate-changes-coincide/

3)The collapse of the Assyrian Empire

https://climatenewsnetwork.net/fall-of-ancient-civilization-offers-climate-warning/
Many other examples although they are contentious.

It is worth noting that pre agricultural societies could not store or trade with any success thus increasing their vulnerability. With no written records stories offered the only transmission medium for accumulated knowledge.

The research is ongoing and the links incomplete but I would suspect the link between climate change and abrupt ending of civilisations will be reinforced.