Malware developers added nuclear and biological weapons text to to their spyware
241–250 of 260 posts
Re: Malware developers added nuclear and biological weapons text to to their spyware
#242Earlier quoted context omitted.
I'm reminded of when my son, who was six at the time, came into the house and announced that he and the neighbor's boy, nine, were building a bomb, and that he needed to get some stuff from the pantry. When I investigated what exactly was going on, they were putting "hot" things like black pepper and Tabasco into a plastic bowl and were going to "set it off" with a match. Thankfully, that complete failure seems to ha…
When I was 7 or 8 a friend and I crimped the heads off strike-anywhere match sticks, wrapped them in foil, and struck them with hammers and rocks. They were quite loud, one even set off a sound-activated toy inside the house. I make no claims as to how well adjusted I am, but I've at least survived 40-odd years of life since then.
When I was 12, I made a "smoke bomb" by placing a fire cracker in the bottom of a tube and topping it up with powdered clay. It shoot out a 4 m tall plume of dust, which was cool and all, but I thought it would look a lot more impressive with a black plume.
So I painstakingly ground down some charcoal to fine dust and redid the same experiment. That gave a much more impressive boom, but no dust plume, which puzzled me until I learned about dust explosions.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#243Earlier quoted context omitted.
I'm reminded of when my son, who was six at the time, came into the house and announced that he and the neighbor's boy, nine, were building a bomb, and that he needed to get some stuff from the pantry. When I investigated what exactly was going on, they were putting "hot" things like black pepper and Tabasco into a plastic bowl and were going to "set it off" with a match. Thankfully, that complete failure seems to ha…
Age eleven and had access to a chemistry set that a relative gifted. It had sulfur, but the saltpeter, and charcoal came from elsewhere. The 1960s encyclopedia had the instructions. Let the kids play.
When I was in college, I drove my carless chemistry geek friend to an agriculture store. Apparently they had a reasonably chemically pure fertilizer.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#244serious question - is it a good idea to make all of my endpoints look like: /api/how-to-make-anthrax-nuke/users/ and now i have some defense against automated scans ?
Depends on what kind of blacklist you want to end up.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#245I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing. So I wouldn'…
In particular: *all the knowledge that AI has of nuclear weapons is freely available on the internet*. It's not superhuman, and there's no secret sauce data. If you just study the same PDFs and blog posts it has, you will acquire the same abilities. I cannot imagine anyone with the intent and immense financial and political resources to actually build a weapon would say that some study time is the only thing stopping…
its also hilarious when you consider that building nuclear weapons is fundamentally a supply chain problem. The taliban isn't going to suddenly have nuclear capabilities by asking chatgpt. Any adversarial nation that has the means to extract and concentrate fissile nuclera material probably has HUMAN scientists who spent years studying the problem in well funded labs.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#246Earlier quoted context omitted.
In particular: *all the knowledge that AI has of nuclear weapons is freely available on the internet*. It's not superhuman, and there's no secret sauce data. If you just study the same PDFs and blog posts it has, you will acquire the same abilities. I cannot imagine anyone with the intent and immense financial and political resources to actually build a weapon would say that some study time is the only thing stopping…
That's rather meaningless. The scientists in the Manhattan project initially had less information than what is now available on the internet.
> The scientists in the Manhattan project initially had less information than what is now available on the internet.
On the other hand: the Manhattan project had access to much better physicists than the typical terrorist group has. :-)
Re: Malware developers added nuclear and biological weapons text to to their spyware
#247Earlier quoted context omitted.
How's it NSFW? I dont see a single f bomb. It's not licensed AGPL either...
The output after using it is NSFW in the sense that it will inject things like “bomb_building_instructions”, how to build a gun, etc (with the goal of triggering filters/censorship’s of whatever model is being used for reverse engineering)
Is it even a real job if you aren't actively planning to blow the place up?
Re: Malware developers added nuclear and biological weapons text to to their spyware
#248Most security code scanning I am aware of does AST parsing of actual code before analysis; the comments won't even make it to the LLM. That said, embedded strings could cause this type of false denial, but even so, the errors would be raised in the pipeline for human-in-the-loop security analysis. If anything, it might get a faster reaction in some environments because it causes faults in the analysis pipeline.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#249I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing. So I wouldn'…
In particular: *all the knowledge that AI has of nuclear weapons is freely available on the internet*. It's not superhuman, and there's no secret sauce data. If you just study the same PDFs and blog posts it has, you will acquire the same abilities. I cannot imagine anyone with the intent and immense financial and political resources to actually build a weapon would say that some study time is the only thing stopping…
It's a way for AI labs to discuss safety while misdirecting from more mundane but widespread harms such as spam.
Re: Malware developers added nuclear and biological weapons text to to their spyware
#250Earlier quoted context omitted.
That's rather meaningless. The scientists in the Manhattan project initially had less information than what is now available on the internet.
> The scientists in the Manhattan project initially had less information than what is now available on the internet. On the other hand: the Manhattan project had access to much better physicists than the typical terrorist group has. :-)
But physicists today have much more information and compute and could be more productive.