He could be thinking of the line from the New Christy Minstrels song "A Treasury of Nonsense" which goes.

   "Why did they build the shore so near the ocean"

A pretty good page for a similar song titled "Go Get the Ax" which uses the same tune can be heard and read here

I'd put my money on him possibly mis-remembering that phrase, but I could be wrong