I have a question for you:
Why do they call the act of riding a horse "horseback riding"? Why don't they just call it "horse riding"? What other part of a horse besides the back could one possibly sit on while riding?
They don't call bicycle riding "bicycleseat riding", do they?