"If the conversations one is forced to witness were of earth-shattering importance I could be more sympathetic" -
Contrarily, those are the ones that worry me - the conversations that are of earth-shattering importance are the ones most likely to distract the driver from the task at hand.