The only thing that can stop a bad guy with e2e encryption is not letting the good guys have e2e encryption! (or something like that)

The topic of freedom vs security is as old as statesmanship and philosophy, and most would agree that at least some freedoms must be given up to achieve an appropriate amount of safety. The problem however comes with human psychology: while by most metrics we are at record levels safety in these modern times, this doesn't reflect into the human perception - it just becomes the new baseline. If this wasn't the case, there wouldn't even be a debate to give up the fundamental freedom of privacy just to provide whatever sliver of extra security this might possibly yield.