Well, all the advice you've received is good, especially that from Leadfingers. I've had neglected batteries totally rot out the contacts that the batteries touch!
The other thing that goes wrong with ancient tapedecks is that the drive-belt breaks. It's made of rubber, and rubber isn't forever.