You are correct - you don't have to answer anyone's questions. But people can see when you duck and dive.

And that's what people remember.

And you will note that the National Autistic Society refers throughout to "AUTISM SPECTRUM DISORDER".

But then of course they don't have the advantage of seeing inside your head.