221
Reasoning failures highlighted by Apple research on LLMs
(appleinsider.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 12 Oct 2024
221 points (95.5% liked)
Technology
59606 readers
3343 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Last I checked (which was a while ago) "AI" still can't pass the most basic of tasks such as "show me a blank image"/"show me a pure white image". the LLM will output the most intense fever dream possible but never a simple rectangle filled with #fff coded pixels. I'm willing to debate the potentials of AI again once they manage to do that without those "benchmarks" getting special attention in the training data.
Lol it do be that way
I will say the next attempt was interesting, but even less of a good try.
Thats actually quite interesting, you could make the argument that that is an image of "a pure white completely flat object with zero content", its just taken your description of what you want the image to be and given an image of an object that satisfies that.
Explanation here: https://youtu.be/NsM7nqvDNJI?t=13m45s
Problem is, AI companies think they could solve all the current problems with LLMs if they just had more data, so they buy or scrape it from everywhere they can.
That's why you hear every day about yet more and more social media companies penning deals with OpenAI. That, and greed, is why Reddit started charging out the ass for API access and killed off third-party apps, because those same APIs could also be used to easily scrape data for LLMs. Why give that data away for free when you can charge a premium for it? Forcing more users onto the official, ad-monetized apps was just a bonus.
Yep. In cryptography there was a moment when cryptographers realized that the key must be secret, the message should be secret, but the rest of the system can not be secret. For the social purpose of refining said system. EDIT: And that these must be separate entities.
These guys basically use lots of data instead of algorithms. Like buying something with oil money instead of money made on construction.
I just want to see the moment when it all bursts. I'll be so gleeful. I'll go and buy an IPA and will laugh in every place in the Internet I'll see this discussed.
I tested chatgpt, it needed some nagging but it could do it. Needed the size, blank and white keywords.
Obviously a lot harder than it should be, but not impossible.
Because it's not AI, it's sophisticated pattern separation, recognition, lossy compression and extrapolation systems.
Artificial intelligence, like any intelligence, has goals and priorities. It has positive and negative reinforcements from real inputs.
Their AI will be possible when it'll be able to want something and decide something, with that moment based on entropy and not extrapolation.
No. Intelligence does not necessitate goals. You are able to understand math, letters, words, meaning of those without pursuing a specific goal.
And our brains work in a similar way.
Our brains work in various ways. Somewhere in there a system similar to those "AI"'s exists, I agree. It's just only one part. Artificial dicks are not the same thing as artificial humans
You sound like those guys who doomed AI, because a single neuron wasn't able to solve the XOR problem. Guess what, build a network out of neurons and the problem is solved.
What potentials are you talking about? The potentials are tremendous. There are a plethora of algorithms, theoretic knowledge and practical applications where AI really shines and proves its potential. Just because LLMs currently still lack several capabilities, this doesn't mean that some future developments can't improve on that and this by maybe even not being a contemporary LLM. LLMs are just one thing in the wide field of AI. They can do really cool stuff. This points towards further potential in that area. And if it's not LLMs, then possibly other types of AI architectures.