this post was submitted on 07 Apr 2025
38 points (100.0% liked)
TechTakes
1788 readers
52 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
LLMs are a lot more sophisticated than we initially thought, read the study yourself.
Essentially they do not simply predict the next token, when scientists trace the activated neurons, they find that these models plan ahead throughout inference, and then lie about those plans when asked to say how they came to a conclusion.
looks inside
it's predicting the next token
every time I read these posters it's in that type of the Everyman characters in the discworld that say some utter lunatic shit and follow it up with "it's just [logical/natural/obvious/...]"
Stands to reason