Wikiquote gives us the following version as a direct translation from a source in Swedish, Sibelius' mother tongue:

It is so difficult to mix with artists! You must choose business men to talk to, because artists only talk of money.

Sibelius was of course referring to himself, who wanted to converse about music, and, being a professional musician himself, was an exception to his rule.