As for microphones, I got a couple sony flat mic's offa ebay for about ten bucks a piece. I like them very much. They're mono, so you'll want two and an adapter to record. Messier with the chords but worth it.

Also got a prof. walkman, which does kick butt. MD may be more convenient and niftier though.