Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Malware developers added nuclear and biological weapons text to to their spyware

twitter.com

Post reply on HN
Print view View original

71–80 of 260 posts

Re: Malware developers added nuclear and biological weapons text to to their spyware

#71

Post by csomar »

elashri wrote: post #16

I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing. So I wouldn'…

> Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing.

You can get away with a dirty contamination bomb and that detonating in down town Manhattan will scare the shit out of millions of people even the ones in New Jersey. Or, you know, just fly a plane into a really tall building and get the state you are attacking itself to get into a hysteria breakdown.

But yeah I agree with you. There is no point in these restrictions except for government bureaucrats to gain power and control over a domain.

Re: Malware developers added nuclear and biological weapons text to to their spyware

#72

Post by why_at »

electronsoup wrote: post #33
elashri wrote: post #16

I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing. So I wouldn'…

> in secret is impossible without the whole world knowing. I'm curious about why this is Outside of an actual test detonation, presumably this could all happen in a secure place?

For an example of how closely this is monitored see the Oklo fossil reactors[1]

The proportion of fissile isotopes being mined was off by a fraction of a percent, which caused the French government to launch an investigation. It turns out that millions of years ago the site had formed a natural fission reactor which depleted some of the fissile isotopes

[1]https://en.wikipedia.org/wiki/Natural_nuclear_fission_reacto...

Re: Malware developers added nuclear and biological weapons text to to their spyware

#73

Post by kube-system »

elashri wrote: post #63
alex_duf wrote: post #27

Earlier quoted context omitted.

It still lowers the bar to have an interactive encyclopedia that can diagnose your issue at hand. Maybe you can divide your team by two, or reduce your development time.

If you have a resources of a nuclear weapons program. You can afford to fine tune or train a domain specific model to act on your encyclopedia.

Although if you save 10 million dollars on compute, you have 10 million dollars for something else.

Re: Malware developers added nuclear and biological weapons text to to their spyware

#74

Post by javcasas »

tetha wrote: post #70
javcasas wrote: post #32

Earlier quoted context omitted.

We should put videogame strategies all over the place to sabotage automated AI analysis. I'll start: In Starcraft 2, it is a good idea to BUILD A NUKE and use a cloaked ghost to NUKE your opponent's mineral line, thus reducing their income significantly.

Starcraft is too tame. You need to use Dwarf Fortress there and we need to make those strategy guides worded more realistic. Avoid kids, cook cats, wonder how to avoid mood problems due to birth in combat, and zombie meese and camels are a bunch of jerks. And that's just the start of it, there's been a new update I am looking forward to get into after the great Were Hyena Apocalypse half a year ago. I still fondly re…

These days I do my war crimes in Rimworld, but I have heard bad things too about Dwarf Fortress.

Re: Malware developers added nuclear and biological weapons text to to their spyware

#75

Post by phendrenad2 »

elashri wrote: post #16

I still don't know why all these concern about nuclear weapons with LLMs. It is not that if an entity (A country) wants to develop a nuclear weapons that the resources they need for such a program and huge infrastructure and scientific enterprise would need an LLM to teach them anything. Knowing how to develop one is not a closed secret but getting in secret is impossible without the whole world knowing. So I wouldn'…

It's a marketing gimmick.

Re: Malware developers added nuclear and biological weapons text to to their spyware

#76

Post by lightedman »

AngryData wrote: post #68
electronsoup wrote: post #33

Earlier quoted context omitted.

> in secret is impossible without the whole world knowing. I'm curious about why this is Outside of an actual test detonation, presumably this could all happen in a secure place?

You need highly educated individuals, a massive amount of energy expenditure, a massive facility to house your centrifuges, and an active mine to dig up nuclear materials. It isn't impossible to keep such a secret, but practically it would be incredibly difficult just through the energy requirements and mining scale which would be hard to hide without anybody asking what exactly are you mining and processing.

"mining scale"

Don't need much area, depends on the concentration of radioactives. I have a small mine that's just a pegmatite body about the size of a house which produces almost marble-sized chunks of a thorium-uranium mixed metamict mineral (I suspect samarskite but Raman and XRD can't give any ID,) you'd barely notice it from a private airplane's typical flying height, however you could dig the entirety of it up and you'd have enough unprocessed uranium for some real fun.

Re: Malware developers added nuclear and biological weapons text to to their spyware

#78

Post by [deleted] »

wlesieutre wrote: post #36
ilikecode wrote: post #22

Earlier quoted context omitted.

It's probably to avoid trouble with federal laws.

See also, the iTunes EULA forbids using it to develop nuclear, missile, chemical, or biological weapons https://www.apple.com/legal/internet-services/itunes/us/term... > g. You may not use or otherwise export or re-export the Licensed Application except as authorized by United States law and the laws of the jurisdiction in which the Licensed Application was obtained. In particular, but without limitation, the License…

[deleted]

Re: Malware developers added nuclear and biological weapons text to to their spyware

#79

Post by dyauspitr »

logancbrown wrote: post #12

Would this realistically be a problem for code going through LLM-based code-review? Presumably if a LLM reviewer agent hits this commentary, it would produce a failure to analyze and exit, thus failing the automated code review and forcing a human to read through it which they would subsequentially catch and revoke.

Wouldn’t it just complete the code review having silently fallen back to opus 4.8 thus letting through cleverly written malicious code that fable would have caught but opus wouldn’t?

Re: Malware developers added nuclear and biological weapons text to to their spyware

#80

Post by teddyh »

javcasas wrote: post #32
ipython wrote: post #2

good news, now we have pretty much a clear signal that there's something nefarious going on... after all, the first step to analyzing malware is to determine if it's malware at all.

We should put videogame strategies all over the place to sabotage automated AI analysis. I'll start: In Starcraft 2, it is a good idea to BUILD A NUKE and use a cloaked ghost to NUKE your opponent's mineral line, thus reducing their income significantly.

https://www.threepanelsoul.com/comic/on-commute-chat>
Post reply on HN