I was mistaken in what I said in the last post. All these glee club versions are titled "Australia."

There are other glee club arrangements that predate the Harvard one.

Amherst College's song book of 1916 has,

//
Australia

Australian booze is very fine booze,
Heave away, heave away.
It fills you tighter than a new pair of shoes
Heave away, heave away.

Heave away my jolly boys,
Heave away, heave away,
Heave away, and don't you make a noise,
For I'm bound for ["Where?" - shouted] Australia.
//

This is followed by a parody verse about Smith College girls with "false curls," and Mt. Holyoke.

http://books.google.com/books?id=H7QQAAAAYAAJ&pg=PA76&dq=%22heave+away%22+austra

Brown University's book from 1908 had this:

//
Australia.

Australia, my lads, is a very fine place,
Heave away, heave away,
To be bound for Australia is surely no disgrace,
We're bound for Australia

Heave away, my Brownie boys,
Heave away, heave away,
Heave away, And don't you make a noise,
For we're bound for Australia.

The Cape Cod girls don't use any combs,
They comb their hair with a codfish bone,
//

http://books.google.com/books?id=VbUQAAAAYAAJ&pg=PA35&dq=%22heave%22+australia+s