Becca72 has it right, in the UK "bugger" as an exclamation means "damn".

By the way, here's something from Wikipedia about the word "Pom" referring to the English:

Quote: The Oxford English Dictionary has recently come out strongly in support of the word being a contraction, listing "pom" and "pommy" under its entry for "pomegranate". A supporting quotation from the Bulletin (Sydney) 14 November 1912: "The other day a Pummy Grant (assisted immigrant) was handed a bridle and told to catch a horse." Unquote