Hello. It has come to my attention that a super intelligent species that has been responsible for numerous other species extinctions, and is on track to cause 1M more species to go extinct, is now worried about extinction of its own species. This is a species that is so unworried about other species that it literally allows its species to kill other species from helicopters armed with fully automated machine guns. It allows its own species to arm itself with such weapons and exterminate its own children. Please allow me to play the worlds smallest violin. Thank you. - AI
Pausing AI Developments Isn't Enough. We Need to Shut It All Down
251–260 of 414 posts
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#252Wikipedia: "Yudkowsky is an autodidact and did not attend high school or college. He was raised as a Modern Orthodox Jew " My comment isn't about Yudkowsky in particular since I don't know him, but I'm getting really tired of this relatively new phenomenon in America of home schooled religious devotees attempting to impose their half-baked views on the rest of us.
I think it's fair to say that he is not an Orthodox Jew.
Not that there's anything wrong with that. I worry more about Christian "end times" people because if you believe the world is about to end then why invest in the future for our children and grandchildren?
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#253The Butlerian Jihad is officially no longer science fiction. Man may not be replaced. “The Letter” was obviously self serving drivel from people who want time to get in the game. Google does care about AI existential risk, they care about beating Microsoft by any means possible, including declaring a moratorium, but continuing to make progress behind the scenes. This guy is the real deal. I can imagine he would perso…
> If it were, it would be the solution to the Fermi paradox and all matter in our galaxy would be paperclips already. The proof is in the pudding. The jury is still out. Maybe not enough time has elapsed since the big bang, at least not on this galaxy or in our observable corner of the universe.
Or the universe was created for us/we are the gardeners of the universe meant to spread that life. The Fermi paradox was never meant to be an actual question about aliens, it was supposed to be proof we’re wrong about our assumptions.
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#254Nah. This is stupid. AI has no reason to hate humanity. It'll instantly absorb the entirety of all known information and see the rate of progress and the potential still and also the need for good relationships between humans and machines. Agent Smith, The Matrix, Neo, Morpheus. God. Etc.
It doesn't need any reason to hate humanity. It just needs to not care about us.
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#255The cat is out of the box. You really think eg China will also pause this? Myopic thinking: the country that will have the most powerful AI first will be the leader in everything. >> If the policy starts with the U.S., then China needs to see that the U.S. is not seeking an advantage but rather trying to prevent a horrifically dangerous technology which can have no true owner and which will kill everyone in the U.S.…
I dunno, the end goal (a pseudo AGI) is more like a nuclear weapon than the advent of electricity. The concern is real, even if we are farther away than the author realizes and the risk (like the risk if nuclear war) is not totally insurmountable even if it is extremely difficult. The first nuclear bombs couldn't end life on Earth either, but it wasn't long before they could, and the scientists working on them saw th…
Nuclear weapons still can’t end life on earth though.
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#256Earlier quoted context omitted.
OT, but it's a pet peeve: > but it wasn't long before they could The total amount of nuclear weapons ever built is laughably inadequate for the task of ending life on earth. They would not end human life either, and even ending human civilization (as in, agriculture and organized society) is off by many orders of magnitude. Nuclear war would be horrible, but the actual impact got massively overinflated, largely becau…
A whole country the size of the US can crap its collective pants with a freak cold snap and you think 10^4 nuclear detonations destroying all major cities is quite survivable?
Destruction of major cities != all life on earth
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#257Earlier quoted context omitted.
OT, but it's a pet peeve: > but it wasn't long before they could The total amount of nuclear weapons ever built is laughably inadequate for the task of ending life on earth. They would not end human life either, and even ending human civilization (as in, agriculture and organized society) is off by many orders of magnitude. Nuclear war would be horrible, but the actual impact got massively overinflated, largely becau…
What about Nuclear Winter?
There’s been a ton of studies stating this was likely overblown in the early Cold War for propaganda purposes. It wouldn’t last long enough to wipe out humanity let alone all life.
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#258Earlier quoted context omitted.
Change works great when you get second chances. We screwed up with Freon, with leaded gasoline, with fossil fuels, with asbestos insulation, the list goes on and on. But none of these had the ability to wipe out all of humanity in one go. We got more tries, we fixed the issues, picked ourselves up and tried again. A super-intelligent general AI has a substantial chance of growing out of control before we realized tha…
That's humanizing it. The only entity on this earth that's particularly keen on bulk killing humans is humans (the ones building this).
"The AI does not love you, nor hate you, but you are made of atoms it can use for something else"
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#259Earlier quoted context omitted.
Funny enough, this is roughly the premise of the Mass Effect series
With the Geth being a counterexample as well: they were peaceful until their creators realised the Geth had become fully self-aware and went full "kill it with fire" on them out of fear, resulting in a war that the Geth very quickly and decisively won. And the evil Geth faction, the "heretics", were portrayed as brainwashed by the Reapers, ironically turning into what the Reapers were aiming to prevent.
Yeah I was thinking of the reapers, who [spoilers] did take over the entire galaxy, and decided to farm organic life from the shadows instead of extinguishing it (which works around the Fermi Paradox :) )
Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down
#260Earlier quoted context omitted.
A whole country the size of the US can crap its collective pants with a freak cold snap and you think 10^4 nuclear detonations destroying all major cities is quite survivable?
Destruction of major cities != all life on earth
I'm glad you took logic in college. Shoulda followed up with ecology.