If you like informal stuff, there is an "Open Mike Night" in The Uplands Tavern, Uplands Square, Swansea. Folk music is often included.

This pub is an excellent music venue.