If it had been me, I'd have told him to 'go away'! He could so easily have grabbed things from your hands. It's sad we can't trust any strangers nowadays, but you have to be so careful.