125
you are viewing a single comment's thread
view the rest of the comments
[-] superminerJG@lemmy.world 40 points 3 months ago

Goodhart's law:

When a measure becomes a target, it ceases to be a good measure.

[-] bionicjoey@lemmy.ca 16 points 3 months ago

The Turing Test (as some people believe it to be): if you can have a conversation with a computer and not tell if it's a computer, then it must be intelligent.

AI companies: writes ML model that is specifically designed to convincingly play one side of a conversation, even though it has no ability to understand the things it talks about.

[-] technocrit@lemmy.dbzer0.com 9 points 3 months ago

It's worth emphasizing that the "Turing Test" is not a good test since it's not at all scientific.

It's just another thought experiment that grifters have taken to the bank.

[-] bionicjoey@lemmy.ca 8 points 3 months ago

Also as Turing proposed it it's meant to be infinitely repeatable. The test isn't supposed to just be if a machine can convince one person with one conversation. That would be trivial. The real Turing test is the converse, it says that there should be no conversation one could have with the machine where it wouldn't convince you it's a human.

[-] kromem@lemmy.world 1 points 3 months ago

The most advanced models absolutely have modeling about what's being discussed and relationships between concepts.

Even toy models have been shown to build world models from very basic training data.

Honestly, read at least a little bit of the relevant research:

https://www.anthropic.com/news/mapping-mind-language-model

this post was submitted on 17 Jul 2024
125 points (95.0% liked)

Technology

59086 readers
2229 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS