When I put a CD in my CD drive, does the machine read the data off the top side of it (where the label is) or off the bottom side?

I ask because I have a CD which someone put a return-address label on, and it's stuck there solidly. Does it matter?