There's nothing erroneous in using the word "homophobia" to mean aversion to homosexuals. That's the only meaning the word has ever had in its brief history.

And regardless of what "phobos" meant in ancient Greek, "phobia" as a combining form in English commonly means an aversion, or a squeamish feeling or anxiety felt in open spaces (agoraphobia) or high places (acrophobia) or in the presence of homosexuals.

Homophobia sometimes leads to hatred, due to anger at the person who aroused the phobia, or anger at the person who calls a man homophobic, since phobia is often perceived as weakness in a man.