Another alternative might be an inexpensive portable Minidisc recorder-
I have a Sharp that I use for field recording- it came with a
split/stereo condenser microphone (the recorder actually supplies
phantom power for it!) The machine is as small as a credit card,
easy to use, and you can record 74 minutes of music onto a minidisc.
There are loads of places out there who can transfer audio from a
minidisc to a CD for you. If your computer has an audio input plug
on it (many do these days!) you can use simple audio editing software
like Bias Peak, or Digidesign Protools (more versatile) to convert
your audio into aiff files or MP3's. I've made some remarkably good
quality recordings this way!