Benny Goodman was also Jewish and there does seem to be some sort of affinity between Jews and African-Americans where music was concerned. Anti Semitism was, of course, common between the wars so that probably helps explain it.