Sounds to me like Eric Bogle's Safe in the Harbour, which contains the lines

"Some men are schemers, who laugh at the dreamers,
Take the gold from the sailors, and turn it to dross"

I haven't time to post in full just now, but will do so if this is the one you are seeking. A lovely song by the way, written in tribute to Stan Rogers.