Rye is gorgeous, if a bit touristy. If you're there the Ypres Castle (or 'Wipers') is worth a call. They have a pub garden that overlooks Romney Marsh. Last time we were there, albeit a few years ago, they actually had draught mild on hand pump!
If you fancy a diversion onto said Romney Marsh, the Red Lion at Snargate has to be one of the most unreconstructed pubs around. Virtually untouched since WWII, and not because it was bombed! The beer regularly gets CAMRA awards. The Woolpack at Brookland is also very nice, and apparently numbers a certain Sir Paul McCartney as one of it's locals.
With all the info. on this thread you'll have to stay for a month!