I think "bugger" has moved out of the offensive category by now. It just means the same as "bloke" now. In countries where the word "bloke" is current, anyway.