this post was submitted on 12 Aug 2025
-9 points (37.1% liked)
Controversial - the place to discuss controversial topics
475 readers
1 users here now
Controversial - the community to discuss controversial topics.
Challenge others opinions and be challenged on your own.
This is not a safe space nor an echo-chamber, you come here to discuss in a civilized way, no flaming, no insults!
Extraordinary claims require extraordinary evidence, "trust me bro" is not a valid argument.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
The 3Wh figure is pretty much "pulled out of the ass". Looking at other sources listed, it does seem true that similar-sized models use ~2-3Wh per query, amortized training included. So yeah I concede the point.