"In the realms of sexuality who makes the rules on what should be tolerated?"

Well, Ake.... since there are so many ideas about that, why not just make the rule simple and say that 'NO tolerance of sexual behavior between adults and children (who are unable to give 'reasoned consent'....but NO rules about the behavior of adults who ARE able to mutually consent (except about where)?

There are many, many aspects of life where people disagree about 'proper' behavior, and I can't think of any way to resolve them except to suggest.."if YOU don't like 'X', don't do it."