this post was submitted on 30 Jun 2025
109 points (96.6% liked)

Mental Health

5375 readers
270 users here now

Welcome

This is a safe place to discuss, vent, support, and share information about mental health, illness, and wellness.

Thank you for being here. We appreciate who you are today. Please show respect and empathy when making or replying to posts.

If you need someone to talk to, @therapygary@lemmy.blahaj.zone has kindly given his signal username to talk to: TherapyGary13.12

Rules

The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:

  1. No promoting paid services/products.
  2. Be kind and civil. No bigotry/prejudice either.
  3. No victim blaming. Nor giving incredibly simplistic solutions (i.e. You have ADHD? Just focus easier.)
  4. No encouraging suicide, no matter what. This includes telling someone to commit homicide as "dragging them down with you".
  5. Suicide note posts will be removed, and you will be reached out to in private.
  6. If you would like advice, mention the country you are in. (We will not assume the US as the default.)

If BRIEF mention of these topics is an important part of your post, please flag your post as NSFW and include a (trigger warning: suicide, self-harm, death, etc.)in the title so that other readers who may feel triggered can avoid it. Please also include a trigger warning on all comments mentioning these topics in a post that was not already tagged as such.

Partner Communities

To partner with our community and be included here, you are free to message the current moderators or comment on our pinned post.

Becoming a Mod

Some moderators are mental health professionals and some are not. All are carefully selected by the moderation team and will be actively monitoring posts and comments. If you are interested in joining the team, you can send a message to @fxomt@lemmy.dbzer0.com.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] ech@lemmy.ca 1 points 13 hours ago (2 children)

Acting like your experience is exemplary of every possible experience other people can have with LLMs is just turning around the blame on the victims. The lack of safeguards to prevent this is to blame, not the people prone to mental issues falling victim to it.

[–] IsThisAnAI@lemmy.world 4 points 9 hours ago

Oh God we're calling them victims now.

[–] ryven@lemmy.dbzer0.com 6 points 13 hours ago (1 children)

Sorry I didn't mean to imply that, let me rephrase: I am surprised that ChatGPT can hold convincing conversations about some topics, because I didn't expect it to be able to. That certainly makes me more concerned about it than I was previously.

[–] ech@lemmy.ca 1 points 12 hours ago

The thing is, it's not about it being convincing or not, it's about reinforcing problematic behaviors. LLMs are, at their core, agreement machines that work to fulfill whatever goal becomes apparent from the user (it's why they fabricate answers instead of responding in the negative if a request is beyond their scope). And when it comes to the mentally fragile, it doesn't even need to be particularly complex to "yes, and..." them swiftly into full on psychosis. Their brains only need the littlest bit of unfettered reinforcement to fall into the hole.

A properly responsible company would see this and take measures to limit or eliminate the problem, but these companies see the users becoming obsessed with their product as easy money. It's sickening.