I think we've seen pretty much the limit of what LLMs can pretend to do. They can sort of spit out code snippets in a stack overflow kind of way, but are not capable of starting with a set of requirements and producing a complex program. Programming has never been about remembering all the syntax and having all the design patterns memorized, that's what documentation and search engines are for. Programming is engineering a complete, maintainable solution given a set of requirements.

I do think LLMs will eat Stack Overflow's lunch as a source of quick code snippets for programmers to copy/paste.

Like most automations they'll never replace us fully. But we're already seeing productivity boosts that will mean not as many people are needed.

Kind of like how excel massively reduced how many accountants you need.