Rapparee, that's the first time I've heard of a rumour about tartrazine affecting male functions, but the "ADHD-like behaviour in children", if that is how it could be described, is not a rumour.
My experience is of a child/teenager being transformed into a (very unhappy and angry) creature yelling obscenities and throwing furniture, after eating something such as an orange ice-lolly. These episodes would be followed the next day by a more recognisable allergic reaction in the form of streaming eyes and runny nose.
There is often no obvious reason to use the food colouring. I found it in tinned butter beans - surely butter beans are supposed to be white. And why would it be necessary to colour mustard yellow?