1102

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[-] Naatan@lemmy.world 0 points 5 months ago

Good lord what is wrong with the people in this thread. The guy is literally owning up to the hard limitations of LLMs. I'm not a fan of him or Google either, but hey kudos for being honest this once. The entire industry would be better off if we didn't treat LLMs like something they're not. More of this please!

[-] Voroxpete@sh.itjust.works 22 points 5 months ago

He's not owning up. He's dismissing.

Pichai acknowledges the problem (how could you not, it's obvious the problem exists), but in a way that basically goes "Yeah, but it's cool, nothing is prefect", shrug, smile.

The part of the problem he's pointedly not acknowledging is this; if the answers generated by this system are so unreliable that we have to double check them every time, using traditional research methods, what is the point of having the AI there in the first place?

[-] Naatan@lemmy.world 1 points 5 months ago

That's fair, but that doesn't appear to be the rationale by most commenters here. I think your point of view is much more constructive and opens up some interesting discussion topics rather than circle jerking over "google CEO bad".

I think the reason Google didn't release their AI before OpenAI did is precisely for this type of issue. OpenAI is now forcing their hand, because often it's not about the best product that wins, but rather the one that got to market first. I feel like what we're seeing now is less about these companies trying to release a product that they strongly believe has user value, but rather it's about these companies creating some sort of foothold such that by the time they figure out what the actual product is they still have some capacity to sell it.

I seriously wonder how the industry would look if OpenAI had not played their hand so soon. Obviously the technology would've arrived regardless, but perhaps the packaging would've been different enough that the miss-understanding around the technology wouldn't be so widespread.

Going back to my original point, it feels like most commenters here are still miss-understanding the technology, because there isn't anything to fix. Making LLMs smarter is impossible, it's inherently "dumb".

load more comments (1 replies)
load more comments (10 replies)
this post was submitted on 27 May 2024
1102 points (98.0% liked)

Technology

59419 readers
3259 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS