In this case, I would use a teeny tiny white lie the next time you're scheduled to get in a car with him. Something like, 'I got in a close call this past weekend when someone else was driving... If you aren't OK with me driving both of us, I'll just meet you there in my car.' This completely takes him out of the equationâitâs an issue that you have, and itâs not personal to him.