Interesting question, Morwen. Did you read this excerpt from Larry Karp's The King of Ragtime? (hope the link works in all nations)
I think that certain American music of the early 20th century was considered "black," and people harbored some doubt that white people could write music like that.
-Joe-