this post was submitted on 22 Jun 2025
779 points (94.5% liked)

Technology

71842 readers
4587 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.

Then retrain on that.

Far too much garbage in any foundation model trained on uncorrected data.

Source.

More Context

Source.

Source.

(page 3) 50 comments
sorted by: hot top controversial new old
[–] Elgenzay@lemmy.ml 22 points 1 day ago (6 children)

Aren't you not supposed to train LLMs on LLM-generated content?

Also he should call it Grok 5; so powerful that it skips over 4. That would be very characteristic of him

[–] hansolo@lemmy.today 7 points 1 day ago* (last edited 1 day ago)

Musk probably heard about "synthetic data" training, which is where you use machine learning to create thousands of things that are typical-enough to be good training data. Microsoft uses it to take documents users upload to Office365, train the ML model, and then use that ML output to train an LLM so they can technically say "no, your data wasn't used to train an LLM." Because it trained the thing that trained the LLM.

However, you can't do that with LLM output and stuff like... History. WTF evidence and documents are the basis for the crap he wants to add? The hallucinations will just compound because who's going to cross-check this other than Grok anyway?

load more comments (5 replies)
[–] nightwatch_admin@feddit.nl 30 points 1 day ago

If we would talk like this, we’d end up in a padded room and drugged to kingdom come. And for good reason, I should say.

[–] NigelFrobisher@aussie.zone 14 points 1 day ago (2 children)

I figure the whole point of this stuff is to trick people into replacing their own thoughts with these models, and effectively replace consensus reality with nonsense. Meanwhile, the oligarchy will utilise mass data collection via Palantir and ML to power the police state.

load more comments (2 replies)
[–] FreakinSteve@lemmy.world 2 points 1 day ago

By the way, when you refuse to band together, organize, and dispose of these people, they entrench themselves further in power. Everyone ignored Kari Lake as a harmless kook and she just destroyed Voice of America. That loudmouthed MAGA asshole in your neighborhood is going to commit a murder.

[–] Archangel1313@lemmy.ca 25 points 1 day ago (1 children)

How does anyone consider him a "genius"? This guy is just so stupid.

[–] const_void@lemmy.ml 11 points 1 day ago (1 children)

Guessing some kind of PR campaign that he purchased to make him look like a genius on TV and movies.

load more comments (1 replies)
[–] Blackmist@feddit.uk 6 points 1 day ago

I'm sure the second Grok in the human centipede will find that very nutritious.

If you use that Grok, you'll be third in the centipede. Enjoy.

[–] antihumanitarian@lemmy.world 11 points 1 day ago

Most if not all leading models use synthetic data extensively to do exactly this. However, the synthetic data needs to be well defined and essentially programmed by the data scientists. If you don't define the data very carefully, ideally math or programs you can verify as correct automatically, it's worse than useless. The scope is usually very narrow, no hitchhikers guide to the galaxy rewrite.

But in any case he's probably just parroting whatever his engineers pitched him to look smart and in charge.

[–] tonytins@pawb.social 23 points 1 day ago

That's a hell of way to say that he wants to rewrite history.

[–] hector@sh.itjust.works 13 points 1 day ago (1 children)

This is it I'm adding 'Musk' to my block list I'm so tired of the pseudo intellectual bullshit with bad interpretation science fiction work

[–] DoubleSpace@lemm.ee 6 points 1 day ago

I think deep down musk knows he's fairly mediocre intelligence wise. I think the drugs allow him to temporarily forget that.

[–] nieceandtows@programming.dev 8 points 1 day ago

What a loser. He'll keep rewriting it until it fits his world-view

[–] minorkeys@lemmy.world 8 points 1 day ago (1 children)

We will take the entire library of human knowledge, cleans it, and ensure our version is the only record available.

The only comfort I have is knowing anything that is true can be relearned by observing reality through the lense of science, which is itself reproducible from observing how we observe reality.

[–] Kurious84@eviltoast.org 10 points 1 day ago (3 children)

Leme guess. The holocaust was a myth is first on his list.

He should just goto hell early.

load more comments (3 replies)
[–] ThePowerOfGeek@lemmy.world 15 points 1 day ago (4 children)

That's not how knowledge works. You can't just have an LLM hallucinate in missing gaps in knowledge and call it good.

SHH!! Yes you can, Elon! recursively training your model on itself definitely has NO DOWNSIDES

[–] Wispy2891@lemmy.world 14 points 1 day ago

And then retrain on the hallucinated knowledge

load more comments (2 replies)
[–] AbidanYre@lemmy.world 15 points 1 day ago

I have Twitter blocked at my router.

Please tell me one of the "politically incorrect but objectively true" facts was that Elon is a pedophile.

[–] wowwoweowza@lemmy.world 4 points 1 day ago

Meme image: Elon ducking his own tiny nub.

[–] RizzRustbolt@lemmy.world 6 points 1 day ago

Good thing he's not trying to rewrite the Human Animus, because that's how you end up losing Deimos.

[–] fluxion@lemmy.world 12 points 1 day ago

What a fucking idiot

[–] umbraroze@slrpnk.net 5 points 1 day ago (2 children)

Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out

[–] Honytawk@feddit.nl 4 points 1 day ago

Maybe someone should write a new Art of War to explain to tech CEOs the basic ins and outs of technology development.

  • Like you can't throw more developers on a project to make it finish faster.
  • Cutting budgets isn't just free money, they come with detriments.
  • You can't scamp on security. It can take a single zero day to bankrupt a company.
  • There are limits to an internet connection. You can't expect everyone to have gigabit internet.

The basic shit every person working in the field understands. Except for the out-of-touch management. Call it the Art of Commerce or something.

load more comments (1 replies)
[–] xenomor@lemmy.world 5 points 1 day ago

Every single endeavor that musk is involved in, is toxic af. He, and all of this businesses, are cancers metastasizing within our society. We really should remove them.

[–] someguy3@lemmy.world 10 points 1 day ago (1 children)

This is the Ministry of Truth.

This is the Ministry of Truth on AI.

load more comments (1 replies)
[–] sentient_loom@sh.itjust.works 9 points 1 day ago (3 children)

adding missing information

From where?

[–] grue@lemmy.world 8 points 1 day ago

Musk's fascist ass.

load more comments (1 replies)
[–] MangioneDontMiss@lemmy.ca 3 points 1 day ago

i'll allow it so long as grok acknowledges that musk was made rich from inherited wealth that was created using an apartheid emerald mine.

[–] DarkCloud@lemmy.world 8 points 1 day ago

"And the Libertarian founding fathers defeated the woke pro-slavery communists, to get rid of the DEI british and found America (which was uninhabited at the time)" -Grok

load more comments
view more: ‹ prev next ›