You should have told him to pull over to let you out, not paid him, and reported him. Bonus points to have recorded evidence first.
Assholes like this, regardless of their current situation, hard times or not, should not be allowed to continue doing this. If I go into work, and push code into production without reviews and approvals, I lose my job or at least get reprimanded. Nothing excuses the behavior you've described.