I've cleaned records with tap water and sometimes with tap water plus dishwashing liquid. If there's anything gritty in the groove, the water washes it away, where a cloth might rub the grit in, scratching the vinyl furhter.

Sometimes I don't even get the water off. You can play a wet record.

Keep in mind that if the records had goo on them, some goo might have been transferred to the needle. You will want to make sure it is nice and clean.