361
submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

Tech experts are starting to doubt that ChatGPT and A.I. ‘hallucinations’ will ever go away: ‘This isn’t fixable’::Experts are starting to doubt it, and even OpenAI CEO Sam Altman is a bit stumped.

you are viewing a single comment's thread
view the rest of the comments
[-] tryptaminev@feddit.de 3 points 1 year ago

Because it can look up code for this specific problem in its enormous training data? It doesnt need to understand the concepts behind it as long as the problem is specific enough to have been solved already.

[-] Serdan@lemm.ee 3 points 1 year ago

I can tell GPT to do a specific thing in a given context and it will do so intelligently. I can then provide additional context that implicitly changes the requirements and GPT will pick up on that and make the specific changes needed.

It can do this even if I'm trying to solve a novel problem.

[-] cryball@sopuli.xyz 1 points 1 year ago

But the naysayers will argue that your problem is not novel and a solution can be trivially deduced from the training data. Right?

I really dislike the simplified word predictor explanation that is given for how LLM's work. It makes it seem like the thing is a lookup table, while ignoring the nuances of what makes it work so well.

load more comments (3 replies)
this post was submitted on 02 Aug 2023
361 points (94.1% liked)

Technology

59390 readers
2712 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS