806
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 18 Jul 2024
806 points (99.5% liked)
Technology
59570 readers
3108 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
I honestly have no Idea what AI does to a processor, and would therefore not pay extra for the badge.
If it provided a significant speed improvement or something, then yeah, sure. Nobody has really communicated to me what the benefit is. It all seems like hand waving.
what they mean is that they are putting in dedicated processors or other hardware just to run an LLM . it doesnt speed up anything other than the faux-AI tool they are implementing.
LLMs require a ton of math that is better suited to video processors than the general purpose cpu on most machines.
Parallel processing capability. CPUs historically worked with mostly-non-massively-parallelizable tasks; maybe you'd use a GPU if you wanted that.
I mean, that's not necessarily "AI" as such, but LLMs are a neat application that uses them.
On-CPU video acceleration does parallel processing too.
Software's going to have to parallelize if it wants to get much by way of performance improvements, anyway. We haven't been seeing rapid exponential growth in serial computation speed since the early 2000s. But we can get more parallel compute capacity.