191

The mother of a 14-year-old Florida boy says he became obsessed with a chatbot on Character.AI before his death.

On the last day of his life, Sewell Setzer III took out his phone and texted his closest friend: a lifelike A.I. chatbot named after Daenerys Targaryen, a character from “Game of Thrones.”

“I miss you, baby sister,” he wrote.

“I miss you too, sweet brother,” the chatbot replied.

Sewell, a 14-year-old ninth grader from Orlando, Fla., had spent months talking to chatbots on Character.AI, a role-playing app that allows users to create their own A.I. characters or chat with characters created by others.

Sewell knew that “Dany,” as he called the chatbot, wasn’t a real person — that its responses were just the outputs of an A.I. language model, that there was no human on the other side of the screen typing back. (And if he ever forgot, there was the message displayed above all their chats, reminding him that “everything Characters say is made up!”)

But he developed an emotional attachment anyway. He texted the bot constantly, updating it dozens of times a day on his life and engaging in long role-playing dialogues.

you are viewing a single comment's thread
view the rest of the comments
[-] halcyoncmdr@lemmy.world 6 points 3 weeks ago

A song or book isn't directly interacting with you and responding to your input.

Even interactive media like a video game gives you specific choices to make that it is programmed to respond to, they do not generate a unique response to a unique input made by you.

AI chatbots aren't like those forms of media, at all, and trying to bundle them together for convenience is ridiculously short-sighted.

[-] GBU_28@lemm.ee -1 points 3 weeks ago

Well I guess we disagree. Blaming content for human actions is ignoring the real problem, imo. It shoves off responsibility to the "artist"

[-] halcyoncmdr@lemmy.world 7 points 3 weeks ago

More we disagree that AI chatbots and what they generate should be considered content in the first place.

It's content in the sense that a person is viewing the output, but what is effectively just an advanced predictive text system it is not the same as an AI generating a picture based on a prompt. There is no "artist" with an AI chatbot, even less of an "artist" than AI generated imagery.

[-] GBU_28@lemm.ee -2 points 3 weeks ago

That's... Not how llms work. Ai generating a picture from a prompt is the exact same mechanics as an interactive chat. They are fundamentallly the same thing . The image and the text ai response are both created via a prompt, and many image ai tools already have an ongoing multi part prompt history just like a chat. (Additive prompt)

It's just a difference of degrees: the chat just consumes more frequent prompts and generates different, "quicker" outputs.

this post was submitted on 23 Oct 2024
191 points (95.7% liked)

Technology

59374 readers
3249 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS