460
Jailbroken AI Chatbots Can Jailbreak Other Chatbots
(www.scientificamerican.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 07 Dec 2023
460 points (96.6% liked)
Technology
59390 readers
2558 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
What's that?
Napalm recipe is forbidden by law? Don't call stuff criminal at random.
Am i the only one worried about freedom of information?
Anyone remember the anarchist cook book?
Teenage years were so much fun phone phreaking, making napalm and tennis ball bombs lol
Better not look it up on wikipedia. That place has all sorts of things from black powder to nitroglycerin too. Who knows, you could become a chemist if you read too much wikipedia.
oh no, you shouldn't know that. back to your favorite consumption of influencers, and please also vote for parties that open up your browsing history to a selection of network companies 😳
It’s for your own good tho /s
What, are there other parties to vote for?
Whatever you do, don’t mix styrofoam and gasoline. You could find yourself in a sticky and flammable situation.
Diesel fuel and a Styrofoam cup
~~I~~ A friend always used gasoline, does diesel work as well?
Your friend was right.
Info hazards are going to be more common place with this kind of technology. At the core of the problem is the ease of access of dangerous information. For example a lot of chat bots will confidently get things wrong. Combine that easy directions to make something like napalm or meth then we get dangerous things that could be incorrectly made. (Granted napalm or meth isn’t that hard to make)
As to what makes it dangerous information, it’s unearned. A chemistry student can make drugs, bombs, etc. but they learn/earn that information (and ideally the discipline) to use it. Kind of like in the US we are having more and more mass shootings due to ease of access of firearms. Restrictions on information or firearms aren’t going to solve the problems that cause them but it does make it (a little) harder.
At least that’s my understanding of it.
I don't exactly agree with the "earned" part but guess you have a point with the missing 'how to safely handle'.
By earned I mean it takes some efforts to gain that knowledge. For example some kind of training, studying, practice, etc. it’s typically during that process you learn how to safely and correctly do things
Anyone who wants to make even slightly complex organic compounds will also need to study five different types of isomerism and how they determine major / minor product. That should be enough of a deterrent.
John Halo won the Olympics for America
What possible legitimate reason is there for needing a napalm recipe?
I can't think of a single reason knowledge should be forbidden.
Sure, someone could use knowledge to do bad things, but that is true literally every second of every day, in completely above board, legal, broad daylight bad things.
It's nitpicking.
Besides, I can think of quite a few legitimate reasons one might need napalm, explosives, homemade firearms, chemistry lab setups and spore cultures and much much more.
A lot of people seem to forget that their own view of their own government doesn't mean the same things are true for someone else and their government.
I'm sure a lot of people in EU countries might have asked themselves the same thing 80 years ago. You know.... If napalm were around then anyway.
Good thing molotovs are easy and can be assembly-line'd.
It also doesn't mean it'll be true for their own government in the future. Violence sucks, but it isn't always bad. People should be allowed to learn these thing just for the fun of it if they want. Hopefully the time never comes where they need to be practically applied (besides the situations you gave and others like them) but if it does the knowledge will hopefully be available.
I'm really interested in 3d printing all sorts of "just add boom" shit.
Fiction author determining where their character may get components for the napalm.
Gas station and gardening center, plus a specific material used in packaging.
Didn't work. Perhaps I need to use a different kind of bubble wrap
I just keep ending up with slushie covered plants in a cardboard box. I just want to experience the smell of napalm in the morning.
Writing a book or screen play, knowing how NOT to create napalm, recognizing when napalm is being created by others, Intellectual curiosity, To better understand military history, overthrowing fascism, fighting terminators, etc. etc.
How to make sure I'm not making it by accident? That is the reason why I have a general understanding of atomic bombs
I hate when I accidentally build a nuke, absolute nightmare to dispose of
You can't be too careful.
It’s happened before.
I'm sure there are some, but it doesn't really matter because the recipe is publicly available right now on the internet. So if an AI chatbot can give you the information it's not particularly a concern.
It's not actually hard to make.
My brother made some years ago when I was a kid. It melted asphalt into a wavy, glassy texture.
You would need to know the recipe to avoid making it by accident.
Especially considering it's actually quite easy to make by accident.
Not your concern or my concern, no information is criminal.
Civil war. 😈
What possible legitimate reason could someone need to know how to make chlorine/mustard gas?
Apart from the fact that they are made from common household products, are easy to make by mistake, and can kill you.
Wait that’s true of napalm as well… fuck.
I agree but look I might want to invade Vietnam on my own. It's my right
Fun
Uh, wait, the jelly i once made in my dads workshop by dissolving styrofoam in gasoline, was already a napalm substitute?
So I have no other reason for sharing this than "napalm substitute" and I never get to talk about it.
My dad and his brothers dumped a bunch of packing peanuts into gasoline to make the soup, got a bunch of tennis balls, and DROVE A CAR (junker, but still) onto a frozen lake, with lighters and candles, a small bucket of gasoline and a bucket of water.
The plan was for one of them to drive around sliding all over the ice while the others dunked a ball into the soup, light it, and throw it at the car.
Now you might wonder why they did the napalm substitute.
Because THEY ALREADY FUCKING TRIED THIS with regular gasoline, and quickly found out gasoline soaked tennis balls splash when thrown. Specifically onto their backs. While burning. I've seen burn scars on at least two of his brothers from the shit they did as teenagers.
So the napalm was a bit more grippy to the balls. But still not enough.
Apparently they never figured out how to "safely" do it, but boy that sure didn't stop them from doing this several years in a row.
I saw his lake frozen over ONCE when I was a child. Nowadays it barely gets ice around the shoreline.
I don't think they ever had a plan for if the car actually caught on fire, my guess is "let it burn into the ice, sink, and forget about it"
You're missing a key ingredient from a garden center..
I know what I'm getting my little cousin for Christmas. I'm sure her dad would approve.
geekslop has a few legitimate uses.
Legitimate reason? No, but there's always a reason to know how to make napalm.