Chinese not only differs in symbols vs words it is also a language that depends on specific pitch as in music. This to me is why different parts of the brain are involved.

A Chinese speaker will use the exact same pitch for certain words when they are tested weeks months or years apart.

Also about 5 times as many Chinese children end up with perfect pitch when compared to American children. This too is probably realted to the sing song nature of the language.