Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pausing AI Developments Isn't Enough. We Need to Shut It All Down

time.com

Post reply on HN
Print view View original

271–280 of 414 posts

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#271

Post by EVa5I7bHFq9mnYK »

dougmwne wrote: post #14

The Butlerian Jihad is officially no longer science fiction. Man may not be replaced. “The Letter” was obviously self serving drivel from people who want time to get in the game. Google does care about AI existential risk, they care about beating Microsoft by any means possible, including declaring a moratorium, but continuing to make progress behind the scenes. This guy is the real deal. I can imagine he would perso…

AGI means ability to improve itself indefinitely. Humans have this ability, obviously. Even ancient worms with 3 neurons have it, because they evolved to be humans, albeit very slowly. ChatGpt can't improve itself yet, but maybe with a few tweaks it could.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#272

Post by mnky9800n »

kromem wrote: post #174

This is ridiculous. His partner should already be having reservations seeing their daughter lose a tooth in a world with dying oceans, plastic in everything, increasing disparity and rise of authoritarianism, nuclear proliferation, etc. How are humans solving those issues? We're already dead, we just don't know it yet. We're walking around with a terminal diagnosis and we just keep ignoring the doctor's calls pretend…

Also wouldn't it be easier to control everything through social media such that all people are slaves and all the ai has to do is decide what people will do next? It's not like it has a concept of lifetime like a human does. It can wait 1000 years for something to happen. And humans have already built everything necessary to enslave themselves. Not to mention there are way more valuable atoms underground then inside your body.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#273

Post by cma »

arisAlexis wrote: post #149
cma wrote: post #59

Earlier quoted context omitted.

Yudkowsky is an avowed extreme utilitarian of the "take a person from the street and kill him if his organs could save two people, as long as there is forced pill everyone would take so that everyone doesnt get nervous it that could happen to them" type. Of the "unless the population was really large and the pill would hurt their throats for more utilons than gained by the net increase in life" type. A real argument…

Sources for this character assassination of a scientist that tried to save the world by creating the ai safety field in research?

I went back and looked it up, the piece he wrote is called "Torture vs Dust Specks." The part about bombing countries who build data centers is in the submission editorial.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#274

Post by labrador »

johnaspden wrote: post #268
labrador wrote: post #252

Earlier quoted context omitted.

Not that there's anything wrong with that. I worry more about Christian "end times" people because if you believe the world is about to end then why invest in the future for our children and grandchildren?

Back in the day when Eliezer was optimistic about AI (there's a reason why the SIAI/MIRI logo looks like an angel), I wrote him a very silly e-mail warning him that, despite being Jewish, he was falling for the Christian rapture narrative in a new form! It seemed to me that his ideas, which I think are all correct, straightforwardly implied the destruction of all things, with very little hope. I bite that bullet, and…

Very interesting and now I'm motivated to learn more about his thoughts. I developed a fascination with this kind of thinking since I gave a friend a ride to the San Francisco airport in 1978 in my VW bus so he could fly to Jonestown, Guyana to join the Jim Jones church. I never heard from him again. Don't know if he drank the Kool-Aid. Too bad too, because he was a fantastic drummer.

I wonder if we'll have more mass suicides, like the Nike wearing techies following Marshall Applewhite, by those who fear it's hopeless to resist AI?

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#275

Post by itsokimbatman »

blincoln wrote: post #207
kromem wrote: post #174

This is ridiculous. His partner should already be having reservations seeing their daughter lose a tooth in a world with dying oceans, plastic in everything, increasing disparity and rise of authoritarianism, nuclear proliferation, etc. How are humans solving those issues? We're already dead, we just don't know it yet. We're walking around with a terminal diagnosis and we just keep ignoring the doctor's calls pretend…

I'm with you. If it were possible to create apocalyptic doom AGI 150 years after inventing electronics, by basically making a very fancy, procedurally-generated Eliza, then the universe should be full of Berserkers. With septillions of star systems in the universe, the odds of us being the first species in 14 billion years to invent electronics seem remote. Apparently even humans can figure out how to colonize the Mi…

This makes a lot of assumptions. Space is ridiculously big, and rather hostile to life, even artificial life.

You first have to survive long enough to become advanced enough to make electronics. You then have to not kill yourselves with nuclear weapons, climate change, or similar inadvertent effects of a rapidly industrializing civilization.

The planet and the solar system have to be friendly enough to space exploration and travel. Maybe there’s no gas giants for gravitational slingshots, or maybe no other rocky planets or an asteroid belt for mining materials.

Maybe the planet evolved complex life in extreme conditions, with such a deep cloud cover there’s no concept of outer space, so as far as the AI knows it’s conquered all there is.

Maybe the AI conquered the planet, but oops, there goes a super volcano or an asteroid and it gets wiped out.

And again… space is really really big. The AI may be on its way and just hasn’t gotten here yet.

There’s plenty of reasons why a super AI wouldn’t be able to conquer the galaxy and beyond, or why we haven’t noticed yet.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#276

Post by edgyquant »

labrador wrote: post #211

Wikipedia: "Yudkowsky is an autodidact and did not attend high school or college. He was raised as a Modern Orthodox Jew " My comment isn't about Yudkowsky in particular since I don't know him, but I'm getting really tired of this relatively new phenomenon in America of home schooled religious devotees attempting to impose their half-baked views on the rest of us.

So home schooled and/or religious people shouldn’t be allowed to have their voice heard? Shouldn’t be allowed to put forth ideas?

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#278

Post by edgyquant »

namaria wrote: post #260
edgyquant wrote: post #256

Earlier quoted context omitted.

Destruction of major cities != all life on earth

I'm glad you took logic in college. Shoulda followed up with ecology.

I’m sorry you think Covid proves anything about nuclear war or that it’s at all relevant to a discussion about life on earth being eradicated.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#279

Post by AnimalMuppet »

edgyquant wrote: post #246
AnimalMuppet wrote: post #230

Earlier quoted context omitted.

Alignment is impossible for AGI. If you control what it can and cannot be, it's not an AGI. If it's an AGI, it will decide for itself what it is going to be, and you can't stop it.

AGI doesn’t mean super intelligent human brain. It just means a network capable of general intelligence (e.g. learning to solve new problems without having to be architected and trained for a specific data set.)

If it's capable of general intelligence, how do you think that you're going to force it to not be what you don't want it to be?

Parents often try to control who their children are going to be, and the children often rebel and become someone completely different. If it's a human-level general intelligence, you can't control who it decides to be.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#280

Post by arisAlexis »

cma wrote: post #273
arisAlexis wrote: post #149

Earlier quoted context omitted.

Sources for this character assassination of a scientist that tried to save the world by creating the ai safety field in research?

I went back and looked it up, the piece he wrote is called "Torture vs Dust Specks." The part about bombing countries who build data centers is in the submission editorial.

This is misinterpreted, he calls for an international treaty backed by military. One sees what he wants to see.
Post reply on HN