Maria Muldaur uses the line "don't like my peaches, papa, don't you shake my tree. You don't like my peaches , papa, lord, lord, let my peaches be." line in her recording of "If You Haven't Hay, Get on Down the Road," (on Waitress in a Donut Shop.) by Nehemiah Curtis "Skip" James, but I don't find that line in any of the lyrics for this song posted on the web.

It makes sense to me that either phrase could likely have been a common colloquialism that had multiple uses, some sexual and some not.