Summer is transient -- thus when it goes away, you expect to be free of its temptations toward sloth and indulgence. A "slave" to summer would be completely ne'e'r-do-well.
In this context summer is a time when one is kept warm by an enjoyable environment.

A