Mrzzy, the line is in the song as a shorthand way to say 'down on the old plantation where I was raised'. Making reference that massa lies buried nearby is simply a shorter and more poetic way to give some background and location information.   It is the place and lost loved ones the fellow is being nostalgic about, not massa.
Sometimes a song is just a song.