I suspect the froglegs connection would have been what made the term stick. It might even have been what Elizabeth had in mind back then. People seem to like to use dietary peculiarities when picking on terms for foreigners - Kraut, Limey, Rosbif...