In primary school (1950s) we often used to taunt each other with "You can't ....   for toffee" which wasn't only confined to singing. I don't know where the expression came from, either.