I found a few when I googled with "unusual pubs names", but anyone can do that.

Here are a few in Oz - just in Sydney:

Blue Cattledog Tavern
White Cockatoo
Doo Duck Inn
Elephant's Foot Hotel
Bald Faced Stag Hotel
Bald Rock Hotel
Nag's Head Hotel
Red Cow Hotel
Red Tomato Inn
Cauliflower Hotel
Bird in Hand Hotel
Friend in Hand Hotel
Four in Hand Hotel
Jolly Frog Hotel
Jolly Swagman
Bat and Ball Hotel
Rag and Famish Hotel
Rose Shamrock and Thistle Hotel(we call it the Three Weeds)

Also, the Erskineville Hotel is known as the Erko, and you can get food named after it, such as Erkoburgers and Chicken Erko.

There's another pub worth mentioning, not in Sydney, but a couple of hour's drive away, called the Loaded Dog, after a famous story by Henry Lawson, also the name of an excellent folk club run by Sandra in Sydney - Hi Sandra.

Jenny