Yebbut "bugger" mean something else before the sexual meaning evolved, whereas "fuck" has more or less always meant what it means now. They're both very ancient words. And, by the way, I'm not one of the "many," as long as both partners cheerily consent to the pastime.