1347
submitted 6 months ago by Sibbo@sopuli.xyz to c/memes@sopuli.xyz
you are viewing a single comment's thread
view the rest of the comments
[-] lordmauve@programming.dev 3 points 6 months ago

I don't deny that this kind of thing is useful for understanding the capabilities and limitations of LLMs but I don't agree that "the best match of a next phrase given his question, and not because it can actually consider the situation." is an accurate description of an LLM's capabilities.

While they are dumb and unworldly they can consider the situation: they evaluate a learned model of concepts in the world to decide if the first word of the correct answer is more likely to be yes or no. They can solve unseen problems that require this kind of cognition.

But they are only book-learned and so they are kind of stupid about common sense things like frying pans and ovens.

[-] 0ops@lemm.ee 3 points 6 months ago

Huh, "book-learned", that's an interesting way to put it. I've been arguing for awhile that the bottleneck for LLMs might not be their reasoning ability, but the one-dimensionality of their data set.

I don't like both-sides-ing but I'm going to both-sides here: people on the internet have weird expectations for LLMs, which is strange to me because "language" is literally in the name. They "read" words, they "understand" words and their relationships to other words, and they "write" words in response. Yeah, they don't know the feeling of being burned by a frying pan, but if you were numb from birth you wouldn't either.

Not that I think the op is a good example of this, the concept of "heat" is pretty well documented.

this post was submitted on 15 May 2024
1347 points (98.6% liked)

Memes

8301 readers
575 users here now

Post memes here.

A meme is an idea, behavior, or style that spreads by means of imitation from person to person within a culture and often carries symbolic meaning representing a particular phenomenon or theme.

An Internet meme or meme, is a cultural item that is spread via the Internet, often through social media platforms. The name is by the concept of memes proposed by Richard Dawkins in 1972. Internet memes can take various forms, such as images, videos, GIFs, and various other viral sensations.


Laittakaa meemejä tänne.

founded 2 years ago
MODERATORS