Over the years I've pretty much come to terms with that. I can go into a space in my head that is fairly peaceful.
Unless the person had insisted upon meeting, intimating an urgency about it. Then when they are late I worry- and can be angry when s/he was late for a stupid reason.
We are complex beings, ain't we.