As Kat says, choirs do it all the time.

Personally I find that I perform worse if I use a book. I am much more likely to lose my place while looking at the audience than I am to forget a song.

If it works for you then go for it, but try to wean yourself from it if you can.