A most modern phones should do all that you want but the battery life can be crap if you use all the functions.

I would suggest ripping or downloading all you want to an mp3 player that uses standard batteries and take a pocketful of spares.

Portable FM radios are common enough, if I needed one I would just put some batteries in the one in the kitchen or, if it was just for weather forecasts, use the car radio.