From Guru.net:"REGIONAL NOTE: Most Southerners recognize the terms goober and goober pea as other names for the peanut. Goober is related to Kongo or Kimbundu n-guba, "peanut." The word is especially interesting as one of a small stock of African language borrowings brought over by slaves..."
I must admit I had always thought of them as being chick-peas but I did learn the song from "The Penguin Book Of American Folk Songs" - thanks for reminding me of the title Bert.
Jon