149
Today's Large Language Models are Essentially BS Machines
(quandyfactory.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 12 Sep 2023
149 points (100.0% liked)
Technology
37702 readers
401 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
I believe I understand everything you are saying and why you are saying it. I think you are completely missing the point, though. LLMs already do quite a few things they were not designed to do. Also, your idea of sentience seems very limited. Yes, with our biological computers we have some degree of presence over "time", but is that critical - or is it just critical for us due to our limited faculties.
What if "the internet" developed some form of self-awareness - would we know? Our entire society could be subtly manipulated through carefully placed latency spikes, for example. I'm not saying this is happening, just that I think you are incredibly overconfident because you have an understanding of LLMs current lack of state etc.
If we added a direct feedback mechanism - realtime or otherwise - we could start seeing more compelling emergent properties develop. What about feedback and ability to self-modify?
These systems are processing information on a level we cannot even pretend to comprehend. How can you be so certain that a single training refinement couldn't result in some sort of spark - curiosity, desire to be introspective, whatever.
Perhaps Hofstadter is losing his mind - but I think we should at least consider the possibility that his concern is warranted. We are not special.
No; they do exactly what they were designed to do, which is convert words to vectors, do math with them, and convert it back again. That we've find more utility in this use does not change their design.
Uh what? Like how would it? This is just technomystical garbage. Enough data in one place and enough CPU in one place doesn't magically make that place sentient. I love it as a book idea, but this is real life.
This would be a significant design divergence from what LLMs are, so I'd call those things something different.
But in any event that still would not actually give LLMs anything approaching: thoughts, feelings, or rationality. Or even the capability to understand what they were operating on. Again, they have none of those things and they aren't close to them. They are word completion algorithms.
Humans are not word completion algorithms. We have an internal existence and thought process that LLMs do not have and will never have.
Perhaps at some point we will have true artificial intelligence. But LLMs are not that, and they are not close.
Are we arguing semantics here?
https://www.jasonwei.net/blog/emergence https://arxiv.org/pdf/2206.07682.pdf https://arxiv.org/pdf/2304.15004.pdf
I could be wrong, obviously, but I don't think this is as straightforward or settled as you are suggesting.
Lol... come on. Your second source disagrees with your assertion:
You are wrong and it is quite settled. Read more, including the very sources you're trying to recommend others read.