Jail - now that's a point. The legal position is in that any place that is open to the public, if there is any singing or dancing or any of that malarky, there has to be a Public Entertainment Licence in place, or the management is in trouble. (The maximum fine is £20,000!)
The only exceptions are that two performers are allowed in a pub in the course of an evening, or whatever; and that religious services in a church or similar premises aren't affected. (And fetes are exempt as well, provided the music in incidental.)
So, is a prison a place that is open to the public? Hard to say isn't it? Not exactly free access in and out, but there's no fee for being a resident.
Anyway, the offender in the PEL context is never the musician or singer, it's the management. Cunning, that is.