Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pausing AI Developments Isn't Enough. We Need to Shut It All Down

time.com

Post reply on HN
Print view View original

161–170 of 414 posts

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#161

Post by iseoulu »

jamilton wrote: post #147
iseoulu wrote: post #101

Earlier quoted context omitted.

Myopic or not, it is what happened. You can't stop sovereign state's willingness to develop a technology if they concluded that benefits coming from the technology is so huge compared to the cost. North Korea was sanctioned to the oblivion but they're not stopping. India is doing fine. There is a treaty completely banning existing nuclear weapons as well as developing new one (TPNW); but none of permenant member of U…

Are you arguing that AGI isn't a potential threat, or merely that this method of trying to prevent it wouldn't work?

Latter.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#162

Post by atemerev »

jamilton wrote: post #153
atemerev wrote: post #127

If AI would be genuinely better than humans, so, what’s the problem? All of us are going to die anyway. I don’t see any difference where our species evolution will be continued, in meat or in silicon. Whatever is better, is fine.

Most people would prefer not to be killed.

Killed by whom? Killing is not the highest form of intellectual expression, which is what we want to achieve.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#163

Post by diziet »

zarzavat wrote: post #137
ilaksh wrote: post #34

Earlier quoted context omitted.

What does the word "super" mean to you? In some ways, GPT4 is already superintelligent. So is ChatGPT 3.5. Do you know anyone who can translate natural language to code as fast as GPT 3.5, or, given a few paragraphs of reference text, perfectly tutor a child on any subject under the sun at a moment's notice like GPT4 is doing for Khan Academy? How many artists do you know who can produce almost any style of artwork w…

Yudkowsky’s example of superintelligence is a chess computer. You can play against stockfish, but you will always lose, even if you are Magnus Carlsen. If you think you are ahead against stockfish, you are wrong. You win a rook, but it has already calculated that it wins it back 10 moves later. Stockfish is superintelligence in a very narrow domain. A superintelligent AGI is that concept applied to general intelligen…

within some constraints it is possible to "beat" stockfish.

Ie, on chess.com I think stockfish times out on bullet games.

Some versions of stockfish can lose vs specific gambits, ie: https://www.youtube.com/watch?v=C5ul6b695Pw https://www.youtube.com/watch?v=TtJeE0Th7rk

of course it is probably much less likely with more cpu times on current version of stockfish.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#164

Post by goldenkey »

m463 wrote: post #84
jamestimmins wrote: post #29

I've used GPT-4, and while extremely impressive, it doesn't feel like we're all that much closer to super-intelligent AI than we were last month or last year. It feels like Google on steroids, but the gap between GPT-4 and AGI still feels massive. This seems like so much putting the cart way ahead of the horse.

The pen is mightier than the sword. And now we've got semiautomatic submachinepens.

The pen IS the sword when all the capitalistic checks are signed by it.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#165

Post by alpaca128 »

dougmwne wrote: post #14

The Butlerian Jihad is officially no longer science fiction. Man may not be replaced. “The Letter” was obviously self serving drivel from people who want time to get in the game. Google does care about AI existential risk, they care about beating Microsoft by any means possible, including declaring a moratorium, but continuing to make progress behind the scenes. This guy is the real deal. I can imagine he would perso…

To quote Joscha Bach's "Lebowski Theorem of Machine Superintelligence":

> No super-intelligent system is going to do anything that is harder than hacking its reward function

Or in other words, there may be a chance a super intelligent AI is possible but won't go full skynet because it's not the most satisfying outcome.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#166

Post by jalapenos »

zarzavat wrote: post #134
jalapenos wrote: post #130

Articles like this are a good reminder that most of mankind's progress has happened not through encouraging innovation, but from preventing those hostile to it from getting in its way. We all have a moral imperative to maximize the rate of innovation, so that the human condition can be improved, and therefore to do whatever we can to frustrate and disempower Luddites and other obstructionists. Team "step on the gas".

You can’t think of any technological innovations that were net negatives? We have a moral obligation to assess every new technology to determine its safety and effects on society. Blindly stepping on the gas in the name of progress is how you end up in a polluted wasteland. There are places like that on planet Earth, but I’m guessing you’d choose not to live there.

I can't think of a legitimacy to this philosophy.

There have been negatives to all advancements, and the solution to all has been further advancements.

The philosophy of "Too much change! Stop! I'm scared!" cannot prevail in a world where another community can say "go ahead, we won't...".

Which is an interesting point in itself. Perhaps the only thing that ultimately stops Luddism is nation state competition.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#167

Post by alpaca128 »

brundolf wrote: post #85
dougmwne wrote: post #14

The Butlerian Jihad is officially no longer science fiction. Man may not be replaced. “The Letter” was obviously self serving drivel from people who want time to get in the game. Google does care about AI existential risk, they care about beating Microsoft by any means possible, including declaring a moratorium, but continuing to make progress behind the scenes. This guy is the real deal. I can imagine he would perso…

Funny enough, this is roughly the premise of the Mass Effect series

With the Geth being a counterexample as well: they were peaceful until their creators realised the Geth had become fully self-aware and went full "kill it with fire" on them out of fear, resulting in a war that the Geth very quickly and decisively won. And the evil Geth faction, the "heretics", were portrayed as brainwashed by the Reapers, ironically turning into what the Reapers were aiming to prevent.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#168

Post by jacknews »

I don't accept the premise that biological life is doomed by superintelligent machines, why would it be?

But there is risk, obviously, which needs to be addressed, yet, quite predictably, in order of concerns, competition for profits or geopolitical advantage is coming first. And second, third, ...

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#170

Post by euroderf »

dougmwne wrote: post #14

The Butlerian Jihad is officially no longer science fiction. Man may not be replaced. “The Letter” was obviously self serving drivel from people who want time to get in the game. Google does care about AI existential risk, they care about beating Microsoft by any means possible, including declaring a moratorium, but continuing to make progress behind the scenes. This guy is the real deal. I can imagine he would perso…

> The Butlerian Jihad is officially no longer science fiction. Man may not be replaced.

I like this phrasing:

"Thou shalt not make a machine in the likeness of a human mind."

It kinda cuts to the chase.

Post reply on HN