Fiddlers are unlikely to have trouble with it, though E is one of the more uncommon keys in traditional dance music in Britain and Ireland.  I suspect that the move to D began with whistle players who found the fingering uncomfortable, or who didn't know how to play in E; certainly some melodeon players would find it a problem as, if I remember correctly, many do not have all the notes required on their instruments.

Malcolm