227
LLMs still don't understand the word "no", much like their creators
(www.quantamagazine.org)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 23 May 2024
227 points (100.0% liked)
TechTakes
1385 readers
111 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 1 year ago
MODERATORS
it's almost like this thing has no internal conceptual representation! I know this can't possibly be, millions of promptfans and prompfondlers have told me it can't be so, but it sure does look that way! wild!
It must have some internal models of some things, or else it wouldn't be possible to consistently make coherent and mostly reasonable statements. But the fact that it has a reasonable model of things like grammar and conversation doesn't imply that it has a good model of literally anything else, which is unlike a human for whom a basic set of cognitive skills is presumably transferable. Still, the success of LLMs in their actual language-modeling objective is a promising indication that it's feasible for a ML model to learn complex abstractions.
if I copy a coherent sentence into my clipboard, my clipboard becomes capable of consistently making coherent statements
Yes, but that's not how LLMs work. My statement depends heavily on the fact that a LLM like GPT is coaxed into coherence by unsupervised or semi-supervised training. That the training process works is the evidence of an internal model (of language/related concepts), not just the fact that something outputs coherent statements.
let me free up some of your time so you can go figure out how LLMs actually work
if I have a bot pick a random book and copy the first sentence into my clipboard, my clipboard becomes capable of consistently making coherent statements. unsupervised training đź‘Ť
this isn't necessarily true. patterns in data aren't by nature proof of an underlying system of logic. if you run the line-fitting machine on any kind of data, its going to output a line. considering just how much data is encoded into these transformers, i don't think we can conclusively say that it has a underlying conception of how language works, much less an understanding of the concepts that language represents. it could really just be using the vast quantities of data it has to output approximately correct statements. there's absolutely structure there, but it doesn't have to have the kind of structured understanding humans have about language to produce language, in the same way a less sophisticated machine learning model doesn't have to know what kind of data its fitting a line to to make a line.
it doesn't. that's why we're calling it “spicy autocompletion” .
It does, which is why it's autocompletion and not auto-gibberish.
Talk about begging the question