There's an interesting thread on "Let Me Fish Off Cape St. Mary's" here (click). The song was written by Otto Kelland, and we have the date of publication as 1947.

I found a Cape St. Mary's on the Bay of Fundy in Nova Scotia. Are we sure the cape the song addresses, is in Newfoundland?

-Joe-