As I understand it, the Roman crowds used the thumbs up sign as a gesture of approval for the victor, and as encouragement fo him to finish the job properly and by killing the defeated opponent. They weren't a particularly nice crowd.