Hmm. Phil Garland (NZ) had an album by that title. Red Allen had a song on the album "Close By" by that title, Jim Cooper (AUS) has one with that title on his album "Drinkers of the Wind, and Jimmy Dean did one titled I Won't Go Hunting With You Jake that has that line in it. Any more clues to help us?