Mrrzy,
I took classical guitar lessons and learned always to hold my finger on a string when changing position. It is very difficult to change position without some guide, especially when you are not watching your fingers. My teacher took great pains to get me to not make noise. It is hard sometimes, especially with new wound strings, but it is better than losing your place on the fingerboard.
Murray