I agree with Matt Milton above however, like he says, the tendency is to be too self critical however, recording yourself does highlight if or when you stray off pitch.
One thing that I picked up from an early playback was my poor diction. I now make a conscience attempt to sing with better pronunciation and not to slur words. I also try and end with strong last notes rather than let them fade away due to laziness or lack of breath.