My memory tells me that the reason they weren't a regular part of the diet of Australians is because the meat is not palatable. This is due to the fact that the koala's diet is restricted solely to eucalyptus leaves and that this imparts a very strong and unappetising flavour to the flesh.
Fergus