249
submitted 11 months ago by misk@sopuli.xyz to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] xor@lemmy.blahaj.zone 13 points 11 months ago

Okay, so let's do a thought experiment, and take off all the safeguards.

Oops, you made:

  • a bomb design generator
  • an involuntary pornography generator
  • a CP generator

Saying "don't misuse it" isn't enough to stop people misusing it

And that's just with chatgpt - AI isn't just a question and answer machine - I suggest you read about "the paperclip maximiser" as a very good example of how misalignment of general purpose AI can go horribly wrong

[-] elbarto777@lemmy.world 5 points 11 months ago

I was going to say that a well-determined individual would find this information regardless. But the difference here is that it being so easily accessible would increase the risks of someone doing something reaaaally stupid by a factor of 100. Yikes.

[-] PsychedSy@sh.itjust.works 2 points 11 months ago
[-] elbarto777@lemmy.world 2 points 11 months ago

For you or many others, for sure it won't be complicated. The world is vast, and the environment you are in is very specific to you. Many other kids may have phones, sure, but they are not in the same environment as you or me.

Some non-sciency kid will have a hard time getting to do what their edgy mind wants them to do, unless an AI guides them mini-step by mini-step.

[-] PsychedSy@sh.itjust.works 3 points 11 months ago

I don't think AI, especially chat bots, will be more useful than a youtuber. It's not particularly easy to make powerful explosives, and gun powder is kind of trash for bombs. I'd imagine chatgpt would blow up more curious kids than aid them lol

[-] PersnickityPenguin@lemm.ee 3 points 11 months ago

The last 2 already exist it's called stable diffusion. And for awhile Bing did it too.

[-] PsychedSy@sh.itjust.works 3 points 11 months ago

I mean half that is deviant art and you can look up how to make explosives on youtube chem channels or in books. It's not hard to rig up a custom detonator if you can get the energetics.

[-] Socsa@sh.itjust.works 2 points 11 months ago

What are we going to do with these Universities, just teaching anyone how to be a chemical engineer!!?

[-] guacupado@lemmy.world 1 points 11 months ago

Jesus some of you guys completely miss the point.

[-] Socsa@sh.itjust.works 1 points 11 months ago

ChatGPT was very far from the first publically available generative AI. It didn't even do images at first.

Also, there are plenty of YouTube channels which show you how to make all sorts of extremely dangerous explosives already.

[-] xor@lemmy.blahaj.zone 1 points 11 months ago

But the concern isn't which was the first generative ai - their "idea" was that AIs - of all types, including generalised - should just be released as-is, with no further safeguards.

That doesn't consider that OpenAI doesn't only develop text generation AIs. Generalised AI can do horrifying things, even just by accidental misconfiguration (see the paperclip optimiser example).

But even a GANN like chatGPT can be coerced to generate non-text data with the right prompting.

Even in that example, one can't just dig up those sorts of videos without, at minimum, leaving a trail. But an unresticted pretrained model can be distributed and run locally, and used without trace to generate any content whatsoever that it's capable of generating.

And with a generalised AI, the only constraint to the prompt "kill everybody except me" becomes available compute.

this post was submitted on 06 Dec 2023
249 points (95.3% liked)

Technology

59419 readers
3942 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS