925
submitted 2 months ago by Alpha71@lemmy.world to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] db0@lemmy.dbzer0.com 53 points 2 months ago

Problem is, you cannot trust it's not hallucinating these stats

[-] potustheplant@feddit.nl 22 points 2 months ago

And even if it's showing the correct number, you can't be sure how trustworthy the source is.

[-] bamboo@lemm.ee 4 points 2 months ago

This applies to any information though, it’s got nothing to do with LLMs specifically.

[-] potustheplant@feddit.nl 4 points 2 months ago* (last edited 2 months ago)

Not really, no. Sources of infornation gain a reputation as time goes on. So, even though you should still check with multiple sources, you can sort of know if a certain bit of information is likely to be correct or not.

On the other hand, LLM's will quote different sources and sometimes it will only provide them if you ask it to. Even then it can hallucinate and quote a source that doesn't actually exist, so there's that as well.

[-] wurstgulasch3000@lemmy.world 12 points 2 months ago* (last edited 2 months ago)

At least it's citing sources and you can check to make sure. And from my anecdotal evidence it has been pretty good so far. It also told me on some occasions that the queried information was not found in it's sources instead of just making something up. But it's not perfect for sure, it's always better to do manual research but for a first impression and to find some entry points I've found it useful so far

[-] db0@lemmy.dbzer0.com 13 points 2 months ago

The problem is that you need to check those sources today make sure it's not just making up bullshit and at that point you didn't gain anything from the genai

[-] wurstgulasch3000@lemmy.world 4 points 2 months ago

As I said the links provide some entry points for further research. It's providing some use to me because I don't need to check every search result. But to each their own and I understand the general scepticism of generative "AI"

[-] db0@lemmy.dbzer0.com 4 points 2 months ago* (last edited 2 months ago)

If you don't check everyone source. It might be just bullshitting you. There's people who followed your approach and got into hot shit with their bosses and judges

[-] GaMEChld@lemmy.world 7 points 2 months ago

There is absolutely value in something compiling sources for you to personally review. Anyone who cannot use AI efficiently is analogous to someone who can't see the utility in a graphing calculator. It's not magic, it's a tool. And tools need to be used precisely, and for appropriate purposes.

My plumber fucks up I don't blame his wrench. My lawyers don't vet their case work, I blame them.

[-] leftzero@lemmynsfw.com -2 points 2 months ago

It's an LLM. Odds are it's hallucinating the sources and they don't even exist.

Know what does compile sources for you which are guaranteed to exist and be related to what you're looking for..? A good old not LLM infected search engine.

If my plumber replaces their wrench for a rabid gerbil claiming it'll be just as good I'm definitely changing plumbers.

[-] Jakeroxs@sh.itjust.works 3 points 2 months ago

Spoken like someone who never even tried to use an LLM and just parrots the bad things they hear online.

Lemmy is full of LLM haters, I get where they're coming from but they take it to the extreme every single time.

[-] db0@lemmy.dbzer0.com 2 points 2 months ago* (last edited 2 months ago)

I'm not an llm hater. I run one of the biggest Foss genai services. It's because of that that I know their limitations.

You said that you're not going to check every search result, which implied you're not checking every time source either which will lead you to eventually believe some llm bullshit. And of you're using an llm just to compile sources that you check with yourself it's no difference than a search engine without llm

[-] Jakeroxs@sh.itjust.works 2 points 2 months ago

I'm a different person then who you were replying to, I know that LLMs do hallucinate/lie/make up sources, but you can quickly check if the sources are real

[-] db0@lemmy.dbzer0.com 1 points 2 months ago

The problem is that even if the sources are real, it's no guarantee that the LLM even used them

[-] Jakeroxs@sh.itjust.works 1 points 2 months ago* (last edited 2 months ago)

I guess? I would also guess your genAI is more of the NSFW variety then an LLM given your alt and what I've seen federated from your server xD

So I definitely treat LLMs like enhanced search, have gotten wrong info but it pointed me in the right direction, in those instances it's still helpful as long as you know it very well will provide confidently inaccurate info

[-] db0@lemmy.dbzer0.com 2 points 2 months ago
[-] Jakeroxs@sh.itjust.works 1 points 2 months ago

I assumed leftzero@lemmynsfw was you? Since you replied to my reply to them as if it was you.

Maybe not tho lol Idk, both have zero in the name so it made sense xD

[-] db0@lemmy.dbzer0.com 3 points 2 months ago

Nah but it's a discussion that spawned from my reply so I'm invested 😁

[-] leftzero@lemmynsfw.com 1 points 2 months ago

No, I'm not db0, but thanks for the compliment. πŸ˜…

I'm way too lazy (and broke) to set up and admin a Lemmy instance.

[-] ZeroHora@lemmy.ml 2 points 2 months ago

The sources are the same result of the search? Or at least the top results?

[-] elucubra@sopuli.xyz 0 points 2 months ago

When I query an AI I always end with "provide sources and bibliography for your reply". That seems to get better replies.

[-] asdfasdfasdf@lemmy.world 7 points 2 months ago

That being said, I can't trust MKBHD is not hallucinating either.

this post was submitted on 05 Sep 2024
925 points (96.7% liked)

Technology

59374 readers
3249 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS