I remember having a similar problem a while back. My ISP suggested that I needed a new modem. Before I got round to buying one, I moved to a new flat, and the problem stopped. I presume that my phone line was 'dirty' in the old place.

As Joe says, it could be lots of things.

Ed