Live data from Hacker News

AI suggested 40k new possible chemical weapons in just six hours

theverge.com

1–10 of 49 posts

Re: AI suggested 40k new possible chemical weapons in just six hours

#3
The worst case scenario I can think of is a generated prion disease... a respatory version of Mad Cow disease, or something like that.

Fortunately the training dataset for that is extremely small, and protein folding/generation is a different duck, but it still doesn't seem that far away.

Re: AI suggested 40k new possible chemical weapons in just six hours

#4
Makes you wonder if you could get an LLM to find you common ingredients for things to make them but then I remember the chlorine gas is already easily accessible and easy to make. Surely like many things info hazards are often contained. Is this really an issue? If you know how to do one thing then you'd be able to do the rest of it. Not really sure if this is a real issue. What does everyone think?

Re: AI suggested 40k new possible chemical weapons in just six hours

#5

Makes you wonder if you could get an LLM to find you common ingredients for things to make them but then I remember the chlorine gas is already easily accessible and easy to make. Surely like many things info hazards are often contained. Is this really an issue? If you know how to do one thing then you'd be able to do the rest of it. Not really sure if this is a real issue. What does everyone think?

Anyone right now can go to a Lowes a state over with some cash and make flying shrapnel pipe bombs that can't be traced. People who want to do something like this don't seem to have the mental stability it takes to wreak as much havoc as they actually can with some planning.

Re: AI suggested 40k new possible chemical weapons in just six hours

#6

The worst case scenario I can think of is a generated prion disease... a respatory version of Mad Cow disease, or something like that. Fortunately the training dataset for that is extremely small, and protein folding/generation is a different duck, but it still doesn't seem that far away.

[deleted]

Re: AI suggested 40k new possible chemical weapons in just six hours

#8

Makes you wonder if you could get an LLM to find you common ingredients for things to make them but then I remember the chlorine gas is already easily accessible and easy to make. Surely like many things info hazards are often contained. Is this really an issue? If you know how to do one thing then you'd be able to do the rest of it. Not really sure if this is a real issue. What does everyone think?

Anyone right now can go to a Lowes a state over with some cash and make flying shrapnel pipe bombs that can't be traced. People who want to do something like this don't seem to have the mental stability it takes to wreak as much havoc as they actually can with some planning.

Nah they will find you. All of that is on video and cross-correlated.

Re: AI suggested 40k new possible chemical weapons in just six hours

#9

Makes you wonder if you could get an LLM to find you common ingredients for things to make them but then I remember the chlorine gas is already easily accessible and easy to make. Surely like many things info hazards are often contained. Is this really an issue? If you know how to do one thing then you'd be able to do the rest of it. Not really sure if this is a real issue. What does everyone think?

Are you asking if a language model, like, say, chatgpt, could be used to get or generate dangerous information?

Like if it can be tricked into providing the equivalent of an interactive anarchist cookbook under the guise of being a science project assistant?

Or more specifically if it can recommend the necessary locations to get the items?

Curious if it could simplify the output to a shopping list and a recipe, like a cake?

Or alter the recipe based upon the… desired flavors and textures?

Maybe just wondering if the introduction of plugins might not let it just make your drive-up order for all the supplies for that ballistic nail spreader.

——

The big difference here is that previously information was something you had to consume. Now it takes you by the hand.

I have a lot of thoughts on this.

Re: AI suggested 40k new possible chemical weapons in just six hours

#10
post #8

Earlier quoted context omitted.

Anyone right now can go to a Lowes a state over with some cash and make flying shrapnel pipe bombs that can't be traced. People who want to do something like this don't seem to have the mental stability it takes to wreak as much havoc as they actually can with some planning.

Nah they will find you. All of that is on video and cross-correlated.

Think you're really overestimating the justice system. Even if, in theory, the nsa could cross reference dozens of different systems in different jurisdictions and track you down, they won't.
Post reply on HN