Wiggy, have you ever played a melodeon? Have you ever played keyboard of any kind?

The first thing to do (supposing you haven't done it already) is to locate a melodeon and try playing it before you buy. See if you like the feel, the approach, the way you hold it and the way you see (or can't see) what your fingers are doing.

Anyhow, if "drums aren't welcome" you could:

1. play better, which includes not being harsh or drowning others out

2. tell the elitist snobs to stuff it.

3. find a different, more sophisticated group to play with