Chris.
This has been discussed before and I wish I could remember the thread. However your question is one that has bothered me over the years for I do the same thing. It started out innocently enough where by I thought it would be a great idea to start writing down words to songs. Only to realize that I stopped memorizing them. It is something I wish I had never done. However I am now in my early sixties and don't give a shit if someone is upset because I didn't memorize a number. I play in festivals, coffee house and pubs with my words and no one has complained. I do agree that it would be great not to use the paper stuff but many many musicians use them. Even the accomplished ones use karaoke machines on the stage pointing at then like monitors.

Bottom line. Just enjoy yourself. You can still pour your heart out in a song even if you are reading the lyrics.
Beer (adrien)