These experts on AI are here to help us understand important things about AI.
Who are these generous, helpful experts that the CBC found, you ask?
"Dr. Muhammad Mamdani, vice-president of data science and advanced analytics at Unity Health Toronto", per LinkedIn a PharmD, who also serves in various AI-associated centres and institutes.
"(Jeff) Macpherson is a director and co-founder at Xagency.AI", a tech startup which does, uh, lots of stuff with AI (see their wild services page) that appears to have been announced on LinkedIn two months ago. The founders section lists other details apart from J.M.'s "over 7 years in the tech sector" which are interesting to read in light of J.M.'s own LinkedIn page.
Other people making points in this article:
C. L. Polk, award-winning author (of Witchmark).
"Illustrator Martin Deschatelets" whose employment prospects are dimming this year (and who knows a bunch of people in this situation), who per LinkedIn has worked on some nifty things.
"Ottawa economist Armine Yalnizyan", per LinkedIn a fellow at the Atkinson Foundation who used to work at the Canadian Centre for Policy Alternatives.
Could the CBC actually seriously not find anybody willing to discuss the actual technology and how it gets its results? This is archetypal hood-welded-shut sort of stuff.
Things I picked out, from article and round table (before the video stopped playing):
Does that Unity Health doctor go back later and check these emergency room intake predictions against actual cases appearing there?
Who is the "we" who have to adapt here?
AI is apparently "something that can tell you how many cows are in the world" (J.M.). Detecting a lack of results validation here again.
"At the end of the day that's what it's all for. The efficiency, the productivity, to put profit in all of our pockets", from J.M.
"You now have the opportunity to become a Prompt Engineer", from J.M. to the author and illustrator. (It's worth watching the video to listen to this person.)
Me about the article:
I'm feeling that same underwhelming "is this it" bewilderment again.
Me about the video:
Critical thinking and ethics and "how software products work in practice" classes for everybody in this industry please.
For the most part, no.
Smartphones could not do many jobs. Some people made a lot of money working in smartphone tech (apps etc) but this is a fundamentally different paradigm.
That being said,
How many successful businesses don't have a website nowadays?
To use my work as an example, I work in a standard IT unit for a large organization. Right now, people send our team all sorts of requests, easier ones get handled by new coders. However, AI will likely be able to do many of those same tasks faster and much cheaper than those junior devs. Someone (I'm hoping me) will get a raise and presumably, implement, train and run that AI.
Junior coders who don't know how to implement it are about to get screwed. And on the other end of the spectrum, senior coders who made a living by being good at very niche knowledge are about to have their exclusive knowledge exploded by AI.
I'm not actually sure learning AI will help much but what else can we do?
That sounds like precisely the opposite of what will happen, because LLMs are not competent at important detail.
@dgerard I do have some anxiety here, though: I know plenty of managers who'd look at the possibility and decide that they're geniuses who have figured out a bold, brilliant plan to cut costs and have a great next quarter. Never mind every person with a technical clue saying it's a irresponsibly bad idea -- those naysayers are just focused on problems, not solutions.
It'll take enormous losses, outages, and data leaks to have a chance of getting through to them...
That's just creative destruction. Plenty of companies in the past have taken big bets on fads and failed, and yet, capitalism has not collapsed and keeps on exploiting workers and the planet.
Am I the only one having Fifth Element playing back in my head atm?
Well, a senior coder is somebody with maybe 5 years experience, tops.
The only way I can see what is at the moment called AI even just touch things like systems design, requirements analysis, technical analysis, technical architecture design and software development process creation/adaption, is by transforming the clear lists of points which are the result of such processes into the kind of fluff-heavy thick documents that managerial types find familiar and measure (by thickness) as work.
I mean that it is incredibly easy to ask an LLM how to do something in a language with which you are unfamiliar. So if you've made a living by being the guy who knows whatever semi obscure language, things are about to change.
That's the dangerous part:
....................................................
You have no way of judging how correct or how wrong the output is, and no one to hold responsible or be a guarantor.
With the recent release of the heygen drag-drop tool for video translating, and lip-syncing tool, I saw enough people say: "Look isn't it amazing, I can speak Italian now"
No, something makes look like you can, and you have no way of judging how convincing the illusion is. Even if the output is convincing/bluffing to a native speaker, you still can't immediately check that the translation is correct. And again no one to hold accountable.
I am talking about coding languages. There are many ways to verify that your solutions are correct.
We are over half a century into programming computers, and the industry still fights itself over basic implementations of testing and using that in-process with development.
The very nature of software correctness is a fuzzy problem (because defining the problem from requirements to code also often goes awry with imprecise specification).
Just because there exists some tooling or options doesn’t mean it’s solved
And then people like you have/argue the magical thinking belief that slapping LLMs on top of all this shit will tooooooootally work
I look forward to charging you money to help you fix your mess later.
Genuine Q: Do you think we’ll start to see llm-friendly languages emerge? Languages that consider the “llm experience” that fools like this will welcome. Or even a reversion back to low-level languages
anything LLM-friendly is likely to be even more high level and less flexible than any ordinary language; as of now, LLMs seem to do the best on something like Python (there’s a shit ton of it and plenty of Python programs can handle a little bit of lexical reorganization without catastrophically failing) but tend to get utterly disastrous results for languages like C, where something seemingly trivial and hard to spot if you don’t know the language like insisting the string “hello world” is 11 characters long (it’s 12 including the null character at the end, which ChatGPT used to consistently fail to do), fucking up the ordering of statements that allocate or free memory, or misindexing an array in memory (along with hundreds of other trivial instances of undefined behavior and a combinatorial explosion of non-trivial cases) can create code that might appear to run fine but has severe security vulnerabilities, or might just silently corrupt data. LLMs aren’t even useful to regurgitate toy code for systems languages like C.
The problem is I guess you'd need a significant corpus of human-written stuff in that language to make the LLM work in the first place, right?
Actually this is something I've been thinking about more generally: the "ai makes programmers obsolete" take sort of implies everyone continues to use javascript and python for everything forever and ever (and also that those languages never add any new idioms or features in the future I guess.)
Like, I guess now that we have AI, all computer language progress is just supposed to be frozen at September 2021? Where are you gonna get the training data to keep the AI up to date with the latest language developments or libraries?
Correct, it presumes that everyone will be eagerly learning new languages, and new features to existing languages, and writing about them, and answering questions about them, at the same rate as before, despite knowing that their work will be instantly ingested into LLM engines and resold as LLM output. At the same time, the audience for this sort of writing will disappear, because they're all using LLMs instead of reading articles, blog posts, and Stackoverflow answers.
It's almost as if no-one has thought this through[1].
Relatedly: https://gerikson.com/m/2023/09/index.html#2023-09-27_wednesday_04
[1] unless the designers of LLMs actually fell for their own hype and believe they actually think.
When you put it that way, I can't help but notice the parallels to Google's generative AI search feature, which suffers from a similar problem of "why would people keep writing posts as the source material for your AI if no one is gonna read it other than the AI web scraper"
It's the ultimate strip-mining of the commons.
this makes sense. It's kind of like crypto being deflationary. There is no incentive to make something new just to feed it. Software has eaten the world and now all it can do is keep eating it's own shit over and over
Yes, with the difference that crypto was never realistically going to replace normal currency. There's a real risk that LLM-generated content kills the open web, though. Both by flooding the zone with generated shit, and by destroying the motivation of humans to add to the inputs.
do you have a rough outline of the steps you see toward the killing of the open web? Do you mean the effect of not realistically being able to stop the scraping of content?
Basically, the incentives to publishing on the open web will go away.
Because all open search results will be LLM-generated, output on the open web will drown in it, and people will flee to silos that can do a better job at keeping that crap out (similar to the tip to add "reddit" to google search queries to avoid the increasingly SEO'd search results). Said silos will either charge money for LLM-ingesters, or forbid them altogether. People will post to silos, either because that's where the content is, or because the silo will claim their input is safe from LLM harvesting[1].
[1] outside nerd circles I don't think this is a big selling point
short answer: unlikely on any nearby time horizon, because there's a large impedance mismatch between the two applicable things at play. maybe some toy sub-examples can be created, but even that rapidly runs into scaling/scoping issues
longer answer: I started typing it and in a thought pause I clicked the upvote arrow on your post and now that in-progress reply is gone (thanks lemmy). I'll write that up in emacs later and then post it here
not if you don’t know the language, and not in any generalized way thanks to the halting problem
How does an LLM "know" a language? By ingesting a huge amount of text and source code around the language. A semi-obscure language, by definition, does not have a huge amount of text and source code associated with it.
Similarly, people who speculate that their processes can be replaced by an LLM pre-suppose that those processes are clearly and unambiguously documented. The fact that there are humans still in the loop means they are not. So you can either make the huge effort of documenting them, then try to train an LLM, or you can just use a boring old language to automate them directly.
LLMs are godawful at obscure languages. not sure how many devs working on non-legacy projects are “the guy who knows whatever semi obscure language” though given how focused the industry is on choosing tech stacks based on dev availability. so I guess your threat is directed towards the legacy projects I’m not doing, or the open source shit I’m doing on my own time in the obscure languages I prefer? cause if there’s one thing I need in my off time it’s a torrent of garbage, unreviewable PRs
That's well put!
I keep thinking/worrying in terms of how I use chatgpt vs what people think chatgpt can accomplish on its own.
To me, I feel like I've been given a supercharger and can handle way more than before by easily double checking syntax of better functions. But if people are relying on chatgpt to code chunks for them, god help them.
I dunno, I do think these LLMs are objectively different and more comprehensive than any IDEA or resource. I don't search for an answer, I just ask a question and get pretty much exactly what I need right away, rather than hunting through resources trying to find the right thing.
To each their own but I'm pretty sure if I can do more work much faster than before, others can too. Unless this creates additional work, I imagine this means fewer devs needed in total. Admittedly, I am a pessimist.
If those were to happen, probably not. Thus far in the almost 10 months of use, I've had zero issues.
Possibly but with the ridiculous investments into the field recently, and thr fact that most nations are seeing the field as a strategic competition, I wouldn't want to bet against AI.
Aaaah, the ‘ole Heaps Of Currency Will Definitely Solve it argument
I’ll never tire of hearing it lapping on the shores, its dulcet lack of understanding reverberating across the scene of sensibility
You should go into VC when you give up on programming - you’d fit into that crowd
it’s weird how the folks who loudly insist their AI bubble hype looks nothing like their previous cryptocurrency bubble hype then immediately revert to crypto arguments without acknowledging it. there’s the classic “there’s so much investment in ~~dogecoin~~ ChatGPT bro how could it go wrong” and of course the asshole programmer classic “it works on my machine/in my editor”, a good stand-in for “bro I already got my lambo, you must be doing bitcoins wrong”. as always, the real innovation in the crypto space was realizing mediocre tech folks are the easiest marks in the world, and when the very same folks at the top went into selling LLMs, they sure as fuck kept that lesson close to heart
lol and then they do a replay of “have fun being poor!” almost on cue
Amazing
I love that their last post ever on this instance was a “bet you haven’t considered this, doesn’t this rock your whole world” masterstroke except it was just a warmed over crypto talking point like they’ve been ignoring the entire rest of the thread mocking
they must've used up all their free learning credits earlier, and hadn't yet decided to pay the $25 for more
Capitalism 2023 edition: if you know one viable extraction, why bother finding another if you can just rebrand? So much cheaper!
I'm reminded of people who have, at every major industrial change, scoffed and said it'll never work.
https://magicvalley.com/news/local/hidden-history-cars-will-not-replace-horses/article_6aca2040-e98a-5fcb-832b-a9be92238417.html
But hey, if you want to insist that your job is completely irreplaceable and plan accordingly, go ahead! It didn't work for the weavers or more recently, factory workers in middle America but this time, you might just be right! At least, you hope so!
I’m reminded of the last broke fucker who told me to have fun staying poor. thanks for the blogspam though!
@self @pikesley why do so many people who are wrong carrying pans for gold look exactly like the NFT grifters di— oh, right
this annoying definition of progress "everyone drives cars now, haha!" as if they aren't one of the worst things we've put on this planet.
I wouldn't be so confident in replacing junior devs with "AI":
It's copy-pasting from stack-overflow all over again. The main consequence I see for LLM based coding assistants, is a new source of potential flaws to watch out for when doing code reviews.
It's worse that "copy-pasting from stack-overflow" because the LLM actually loses all the answer trustworthiness context (i.e. counts and ratios of upvotes and downvotes, other people's comments).
That thing is trying to find the text tokens of answer text nearest to the text tokens of your prompt question in its text token distribution n-dimensional space (I know it sound weird, but its roughly how NNs work) and maybe you're lucky and the highest probability combination of text-tokens was right there in the n-dimensional space "near" your prompt quest text-tokens (in which case straight googling it would probably have worked) or maybe you're not luck and it's picking up probabilistically close chains of text-tokens which are not logically related and maybe your're really unlucky and your prompt question text tokens are in a sparcelly populated zone of the n-dimensional text space and you're getting back something starting and a barelly related close cluster.
But that's not even the biggest problem.
The biggest problem is that there is no real error margin output - the thing will give you the most genuine, professional-looking piece of output just as likely for what might be a very highly correlated chain of text-tokens as for what is just an association of text tokens which is has a low relation with your prompt question text-token.
Isn't the lack of junior positions already a problem in a few parts of the tech industry? Due to the pressures of capitalism (drink!) I'm not sure it will be as easy as this.
I said I wouldn't be confident about it, not that enshitification would not occur ^^.
I oscillate between optimisim and pessimism frequently, and for sure ~~some~~ many companies will make bad doo doo decisions. Ultimately trying to learn the grift is not the answer for me though, I'd rather work for some company with at least some practical sense and pretense at an attempt of some form of sustainability.
The mood comes, please forgive the following, indulgent, poem:
Worse before better
Yet comes the AI winter
Ousting the fever
Aha yeah, im in a pretty pessimistic place atm.
The outsourcing trend wasn't good for junior devs in the West, mainly in english-speaking countries (except India, it was great there for them).
I work in support too, and predict a long and profitable career cleaning up the messes the AI will create.
Nah bro, when GPT-5 comes out all code it'll write will exactly match the specification, and it'll also sim the entire universe to guess your mental state and correct any mistakes you made in your specs.
The singularity happens. We invent the basilisk. But, oops, the alignment we ended up with is the frustrations of hundreds of thousands of derailed projects, and poor ‘ole basi just gets to write corpware forever
Conway’s law strikes again!