Arnie,
The word "Celt" comes from the Greek "Keltoi", meaning "stranger".
Greek has no soft "c", so it should be pronounced with a k sound.

I confess to being no Gaelic scholar, I just Googled it.
The poor man's doctorate.

John