If the system sounds "clean" at the volume you like, all is well. If the sound becomes even slighty "harsh" or "dirty", back off on the volume. The objectionable sound is caused by "clipping" and means that the amp has exceeded its maximum output. Clipping causes the production of huge amounts of "harmonics", usually odd-order, which will certainly cause speaker damage if allowed to continue for long period of time.