I've seen piano teachers write "Look" on piano music, and I've seen Ranger Doug of the Riders of the Trail look down at his fretboard to get a certain chord. I figure that looking at your instrument is all right.
We've probably all seen fine musicians look at their instrument and haven't given it a thought.