Of course, these days, an iPhone with an audio recorder app, or an iPod with a TuneTalk plugged in will do that stuff as well. I can personally attest that both of those solutions work surprisingly well and provide surprisingly high quality for what they are.

Or even a laptop with a mic plugged into its input jack. There, you've got the option of using a pretty high quality microphone if you want.