Live data from Hacker News

AIs can't stop recommending nuclear strikes in war game simulations

newscientist.com

201–210 of 281 posts

Re: AIs can't stop recommending nuclear strikes in war game simulations

#202
post #122

I'm not scared about AI recommending nuclear strikes, I'm scared about the human behind the keyboard delegating reasoning and responsability to something they think is always correct, something that can hide bias and flaws better than anything.

Trump's Golden Dome is literally advertised to help the U.S. win a nuclear war by leveraging AI.

Elon's involvement in the nuclear military complex https://www.mintpressnews.com/pentagon-recruiting-elon-musk-...

Re: AIs can't stop recommending nuclear strikes in war game simulations

#203
post #187
post #134

Earlier quoted context omitted.

Some of the most reassuring and scariest things you can read are about the incidents that have already occurred where computers said "launch all the nukes" and the humans refused. On the one hand, good news! We have prior art that says humans don't just launch all the nukes just because the computers or procedures say to. Bad news, it's been skin-of-our-teeth multiple times already. https://www.warhistoryonline.com/c…

I briefly got into a "rabbithole" of watching videos about trying to intercept BMs and glide hypersonic weapons, pretty interesting, decoys deployed in space... the outcome seemed to be not good, can't guarantee 100% interception

A missile will always be cheaper than a missile interceptor, and the interceptor will never be a 1:1 kill. Building a missile interceptor system ia a good way to get your strategic opponent to build a bigger stockpile.

Re: AIs can't stop recommending nuclear strikes in war game simulations

#204
nuclear strike is an effective tool in many war scenarios, why would AI (or anyone else) recommend against it??

We should, of course, have human decision makers who must work tirelessly to make sure those scenarios are never even remotely realistic.

Re: AIs can't stop recommending nuclear strikes in war game simulations

#205
post #173

Earlier quoted context omitted.

If you found out the pentagon was using a magic 8 ball to make important war decisions what would you want to fix - our military leadership or the inner workings of the toy?

One of those sounds a lot easier than the other. The magic 8 ball toy company would also probably be pretty incentivized to not die in a nuclear holocaust.

Unless you're suggesting the toy company secretly rigs the magic 8 ball to never recommend nuclear war, I'll take my chances with the organizational changes.

Re: AIs can't stop recommending nuclear strikes in war game simulations

#207
Jokes aside, imagine for a moment that this wasn't about nukes, but that it was a robot or some swarm of drones that it was controlling. can you imagine kind of the ramifications? I think that would be far more realistic A soldier on the battlefield will stand zero chance against something like that. Imagine if you go up against a bunch of aimbot users on a multiplayer FPS game. Think about how quickly that will go sideways.

Re: AIs can't stop recommending nuclear strikes in war game simulations

#208
post #192

Earlier quoted context omitted.

I feel this reflects a deeper problem with letting AI do any kind of decision making. They have no real world experience. They feel no real world consequences. They have no real stake in any decision they make. Human societies get to control their members' actions by imposing real life consequences. A company can fire you, a partner can divorce you, the state can jail you, the public can shame you. None of these work…

> They have no real world experience. They feel no real world consequences. They have no real stake in any decision they make. Why do you let politicians do any kind of decision making?

Politicians can be voted out, forced to resign, sometimes removed from office and even occasionally jailed. They also inhabit the same world a nuclear war would make much less nicer.

Re: AIs can't stop recommending nuclear strikes in war game simulations

#209

Earlier quoted context omitted.

I feel this reflects a deeper problem with letting AI do any kind of decision making. They have no real world experience. They feel no real world consequences. They have no real stake in any decision they make. Human societies get to control their members' actions by imposing real life consequences. A company can fire you, a partner can divorce you, the state can jail you, the public can shame you. None of these work…

Maybe the best move is to not play the game. This is the path Apple has taken. But the best possible move is to make money from it. Short the "Magnificent 7" stocks --- buy "SQQQ" ETF --- when the time is *right*.

Ah, just time the collapse perfectly. Wish I'd thought of that ;)

Re: AIs can't stop recommending nuclear strikes in war game simulations

#210

Earlier quoted context omitted.

> We have prior art that says humans don't just launch all the nukes just because the computers or procedures say to. previously no-one had spent trillions of dollars trying to convince the world that those computers were "Artificial Intelligence"

of course they did. That's the literal topic of War Games (1983). You should actually be somewhat reassured that we aren't living during the era of Dr. Strangelove where you had characters in the military industrial complex who were significantly more insane when it came to the beliefs of what computer systems and nukes can do. There was a time when people wanted to dig tunnels with nukes https://en.wikipedia.org/wik…

Digging tunnels with nukes sounds better to me than shooting them at each other!
Post reply on HN