this post was submitted on 17 Sep 2025
177 points (97.8% liked)
Fuck AI
4126 readers
1046 users here now
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Current AI models have been trained to give a response to the prompt regardless of confidence, causing the vast majority of hallucinations. By incorporating confidence into the training and responding with "I don't know", similar to training for refusals, you can mitigate hallucinations without negatively impacting the model.
If you read the article, you'll find the "destruction of ChatGPT" claim is actually nothing more than the "expert" making the assumption that users will just stop using AI if it starts occasionally telling users "I don't know", not any kind of technical limitation preventing hallucinations from being solved, in fact the "expert" is agreeing that hallucinations can be solved.
You've done a lot of typing and speak very confidently, but ironically, you seem to have only a naive understanding of how an LLM works and how they are trained, and are just parroting misconceptions and talking points that aren't really correct.
Probably because these pro AI folks tend to use AI to form responses.