Chicken Charlie is only partly correct. The voters in Connecticut voted to abolish the office of High Sheriff on Nov. 7, 2000; an office which had existed for 350 years. Custody of prisoners and responsibility for court security was taken over by the judicial branch.
Other states, and even the Cherokee Nation, had high sheriffs. Gone now, but when the song was written, the jurisdiction where the song originated may have had a high sheriff.