All the people recommending mouth organs are obviously naturals at playing by ear. I never could get a tune out of those that I pulled out of my Christmas stocking.
A keyboard to learn the basics on and something small to leave lying around to pick up and noodle on, maybe. Swanee whistle???