My mother of Irish/Welsh/Cornish descent taught the song to us this way:

All the same as above but last part:

But, no, tis not a boy at all;
'Tis Ifgus (spelling is just phonetic) Castle spires so tall.

I have been looking for an Irish spelling for the castle and no luck in the Bristish Isles either.