Oh, get over yourself!

A church is a *building*. When it is being used for worship, then it is more than a building. At other times, including when secular concerts are being held, it's a building.

The only thing to consider really is whether you want to support the artist performing, or not. Possibly also you might want to consider if by doing so you are helping the owners of the building, whoever they might be, defray the costs of keeping that building going so that it can be used for public events.

In my experience, churches never charge anything like an economic rent for the use of their space and are only too happy to support worthy performers by letting them have use their facilities.

I think you are being far too precious.