606
Dreams come true (mander.xyz)
you are viewing a single comment's thread
view the rest of the comments
[-] ininewcrow@lemmy.ca 108 points 1 day ago* (last edited 17 hours ago)

How many of these books will just be totally garbage nonsense just so they could fulfill a prearranged quota.

Now the LLM are filled with a good amount of nonsense.

[-] poplargrove@lemmy.world 4 points 6 hours ago

That would be terrible because they are both some of the best academic publishers in the humanities.

[-] Tolookah@discuss.tchncs.de 58 points 1 day ago

Just use the llm to make the books that the llm then uses, what could go wrong?

[-] runner_g@lemmy.blahaj.zone 28 points 21 hours ago

Someone's probably already coined the term, but I'm going to call it LLM inbreeding.

[-] anzo@programming.dev 2 points 8 hours ago

In computer science, garbage in, garbage out (GIGO) is the concept that flawed, biased or poor quality ("garbage") information or input produces a result or output of similar ("garbage") quality. The adage points to the need to improve data quality in, for example, programming.

There was some research article applying this 70s computer science concept to LLMs. It was published in Nature and hit major news outlets. Basically they further trained GPT on its output for a couple generations, until the model degraded terribly. Sounded obvious to me, but seeing it happen on the www is painful nonetheless...

[-] Naz@sh.itjust.works 15 points 21 hours ago

I suggested this term in academic circles, as a joke.

I also suggested hallucinations ~3-6 years ago only to find out it was ALSO suggested in the 1970s.

Inbreeding, lol

[-] chicken@lemmy.dbzer0.com 4 points 20 hours ago

The real term is synthetic data

[-] Benn@lemm.ee 3 points 20 hours ago

It's quite similar to another situation known as data incest

[-] thesporkeffect@lemmy.world 3 points 21 hours ago

Soylent AI? Auto-infocannibalism

[-] rickyrigatoni@lemm.ee 3 points 22 hours ago

It can only go right because corporations must be punished for trying to replace people with machines.

this post was submitted on 28 Sep 2024
606 points (99.2% liked)

Science Memes

10464 readers
2540 users here now

Welcome to c/science_memes @ Mander.xyz!

A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.



Rules

  1. Don't throw mud. Behave like an intellectual and remember the human.
  2. Keep it rooted (on topic).
  3. No spam.
  4. Infographics welcome, get schooled.


Research Committee

Other Mander Communities

Science and Research

Biology and Life Sciences

Physical Sciences

Humanities and Social Sciences

Practical and Applied Sciences

Memes

Miscellaneous

founded 2 years ago
MODERATORS