Except if you view tolerance as what it is, a social contract. I'll tolerate you as long as you tolerate me.
Thus I get along great with the religious person that just wishes to practise their religion in peace, and respects my existence as a connoisseur of cock outside of it, but we don't have to put up with the neo-nazis calling for both of our heads.
And so the paradox dissolves.