Well, I dunno if we feel guilty exactly, but in the big sound chamber that is our church, every once in awhile we (the clergy family) will let loose in the great acoustics for just us. It started with a deep bass version of Swing Low Sweet Chariot, as if done by a bunch of black street corner crooners, completely exaggerated, and a welcome chest-voiced relief to the 2 sopranos involved in that night's praise service just a while earelier that night.
Another time our band was practicing in there, and we got pretty jazzy with one of the most overdone praise pieces, and I think I started it, kind of jazzy and scatty with an odd quirk to the melody in the place where one of us ALWAYS screws up the rhythm. They were kinda taken aback and then went with it. Now we can't do the thing in public anymore because the new version would be a scandal and the old one just cracks us up, remembering.
Now when my step daughter and I warm up in there before the service, I can't seem to resist using my fingerpicks on the rock maple stand my autoharp sits on, to rap out a tap dance. God help us all if I take the claves to church. And I'll whistle whatever has been in my head all day (of course it sounds GREAT), and the people filter in grinning at me because they just know that isn't church music-- it's blues!!
Not sure how much longer I'm good for in church ministry. I just put a better amp on layaway-- and I'm goin' up the road with Hardiman, to the empty restaurant, to try me a regular set in a couple of weeks. The waitresses assure us we'll be welcome to try it out, and they have no evening business to speak of, to scare away!