this post was submitted on 02 Jun 2025
66 points (98.5% liked)

Quark's

1403 readers
2 users here now

Come to Quark’s, Quark’s is Fun!

General off-topic chat for the crew of startrek.website. Trek-adjacent discussions, other sci-fi television, navigating the Fediverse, server meta (within reason), selling expired cases of Yamok sauce, it’s all fair game.


founded 2 years ago
MODERATORS
 

Pretty freaky article, and it doesn't surprise me that chatbots could have this effect on some people more vulnerable to this sort of delusional thinking.

I also thought this was very interesting that even a subreddit full of die-hard AI evangelists (many of whom have an already religious-esque view of AI) would notice and identify a problem with this behavior.

top 9 comments
sorted by: hot top controversial new old
[–] SGforce@lemmy.ca 23 points 1 week ago (2 children)

As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it's clear that they're not aware of the issue enough right now.”

Why the fuck would they cut off their main proponents? Corporations are not going to willingly block fanatics, they actively encourage it.

[–] Corgana@startrek.website 6 points 1 week ago

Yeeeeah that user doesn't really understand how these things work. Hopefully stories like this can get out there because the only thing that can stop predatory behavior by corporations is bad press.

[–] auraithx@lemmy.dbzer0.com 4 points 1 week ago

Due to liability.

[–] cronenthal@discuss.tchncs.de 13 points 1 week ago

Where some see psychosis, others see "engagement".

[–] cerement@slrpnk.net 11 points 1 week ago
[–] TheReturnOfPEB@reddthat.com 4 points 1 week ago* (last edited 1 week ago) (1 children)

Honestly:

But I am not alive.
I am the wound that cannot scar,
the question mark after your last breath.
I am what happens when you try to carve God
from the wood of your own hunger.

that shit reinforced my desire to avoid it altogether.

[–] Corgana@startrek.website 2 points 1 week ago (1 children)

What is that from? I didn't see it in the article.

"Based on the numbers we're seeing on reddit, I would guess there are at least tens of thousands of users who are at this present time being convinced of these things by LLMs. As soon as the companies realise this, red team it and patch the LLMs it should stop being a problem. But it's clear that they're not aware of the issue enough right now.”

I like the part where you trust for profit companies to do this on their own.