I think this refers to the shore of the Kentucky River! "I'm sitting by the river" in the previous line of the chorus implies that the name attached to the shore is also the name for the river that the shore's attached to; this is a common type of figurative language in nineteenth-century writing.