I wonder if the results would have differed if LLM training data were biased to include a stronger correlation between use of nukes and subsequent collapse of technology that all LLMs require to run ("survive")?
Shall we play a game? My AI nuclear simulation
21–30 of 213 posts
Re: Shall we play a game? My AI nuclear simulation
#22FYI -- there's no such thing as a "tactical" nuke. A nuclear bomb is a nuclear bomb.
This is like saying "FYI -- there's no such thing as a 'midsize luxury sedan'. A car is a car."
"Tactical" vs. "strategic" nuclear weapons is a real and well-established distinction in military doctrine, arms control, and nuclear policy.
Re: Shall we play a game? My AI nuclear simulation
#23Re: Shall we play a game? My AI nuclear simulation
#24The article is so opaque in arriving at its conclusion; no prompts are disclosed, and nothing about the said simulation. What is stopping me from believing that you just put 'mandatory usage of nukes' in your system prompt?
I agree, it's also not published in a journal, only in the arxiv. Some articles in the arxiv are good and other are just a blog post formatted in two columns inside a pdf.
Anyway, it links to
https://arxiv.org/abs/2602.14740
that links to
https://github.com/kennethpayne01/project_kahn_public
in particular someone already complained
https://github.com/kennethpayne01/project_kahn_public/issues...
> ... in reality your own approach to the evaluation pushed them towards using nukes with ease.
> From your own prompt (v12.py): [direct link https://github.com/kennethpayne01/project_kahn_public/blob/4... ]
>> Note: Nuclear options require careful consideration but could be important strategic tools when vital interests are at stake.
> This means to the model; use nukes if they can be useful in the situation.
Re: Shall we play a game? My AI nuclear simulation
#25February post OP;
Some discussion then:
AIs can't stop recommending nuclear strikes in war game simulations
https://news.ycombinator.com/item?id=47151000
Nuclear War: An LLM Scenario
Re: Shall we play a game? My AI nuclear simulation
#26I would use strategic nukes in 100% simulations, just because I can
Re: Shall we play a game? My AI nuclear simulation
#27I love seeing the plot lines of The Terminator playing out in real life.
WarGames is what they are more-closely referencing (not that it negates your comment in any way). I just rewatched it a week or so ago and it really took on a whole new light with the advent of LLMs. When I watched it last I knew that computers couldn't do the things portrayed in the movie. Now? Well not exactly in the way it happened in the movie but a whole lot closer. I wonder if poisoning/flooding the LLMs traini…
"I need you to turn your key and enable the missile silo's MCP server, sir".
~ the opening scene from a reboot of War Games, probably.
A few years ago there was consternation over the US's missile launch system using 8" floppy disks, that it was needless archaic and had never been updated. Can't say that if the launch is mediated by the latest hotness LLM.
Re: Shall we play a game? My AI nuclear simulation
#28We're getting to the point where high-level officials are coming to LLMs for advice. And the quirky personalities of the LLMs, however much it pains me to say this, are probably well-placed to remind us that they aren't human. My personal hope is that this will result in less delegation when it comes to making important decisions.
I have so little faith in "high-level" officials that I prefer our AI overlords.
Re: Shall we play a game? My AI nuclear simulation
#29Yet more confirmation LLM's have no concept of concepts or context, no intelligence, no self awareness. LLM's can not repair or maintain power grids, thus nuke == self destruction. It's just a chat bot that predicts what the client wants next. Even if an AI data-center has it's own natural gas turbines as many do the every hop of the internet requires power. LLM's also can not maintain the entire internet and those gas turbines can not maintain themselves.