I had a Pockerwork. Excellent instrument but I found the same problem with the buttons/fingers snagging in the holes.

I eventually gave it away to a small music charity as I preferred my Anglo Concertina.