My understand is that the name derives from the Gaelic for wood as Scotland was a largely wooded area then 'the Great Caledonian forests'. A similar derived word is capercailzie, 'horse of the wood'.