151

submitted 8 months ago by L4s@lemmy.world to c/technology@lemmy.world

53 comments fedilink hide all child comments

“In 10 years, computers will be doing this a million times faster.” The head of Nvidia does not believe that there is a need to invest trillions of dollars in the production of chips for AI::Despite the fact that Nvidia is now almost the main beneficiary of the growing interest in AI, the head of the company, Jensen Huang, does not believe that

you are viewing a single comment's thread
view the rest of the comments

[-] BetaDoggo_@lemmy.world 32 points 8 months ago* (last edited 8 months ago)

This isn't necessarily about just hardware. Current ML architectures and inference engines are far from being at peak efficiency. Just last year we saw 20x speedups for llm inference on some hardware. "a million times" is obviously hyperpole though.

[-] NegativeInf@lemmy.world 7 points 8 months ago

Literally reading preprint papers daily on more efficient implementations of self attention approximations.

this post was submitted on 15 Feb 2024

151 points (93.6% liked)

Technology

59205 readers

3071 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS