Here's what I think.

Step 1 - you have to know the melody by heart

Step 2 - have an accompaniment going. Try to be aware of it, but don't try to copy it.

Step 3 - start softly and try singing harmony notes. If they don't work, try something else. Do this until you have a something good.

This has worked in my church choir many times.