"Why not just accept that Andy Williams made it up?"

First of all, because maybe Andy Williams didn't just make it up. Secondly, because the rest of the lyrics seem so well crafted, and it's such a beautiful song, that I, for one, would like to think that that distinctive term actually means something, rather than just being nonsense syllables that serve no purpose other than to fill some space with vocal sound.