Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Could Defeat All of Us Combined

cold-takes.com

Post reply on HN
Print view View original

81–90 of 114 posts

Re: AI Could Defeat All of Us Combined

#81

Post by sweetbitter »

kelseyfrog wrote: post #27

What a limited imagination of how an AI would take over. The scenarios seem to be centered around an extrapolation of "What if a really smart human were trapped inside a computer?" The amount of anthropomorphism is astounding. The author misses an even scarier prospect - people will want to run such an AI. They will be absolutely giddy at the prospect of running such an AI and it won't be anything like a really smart…

> The author misses an even scarier prospect - people will want to run such an AI. They will be absolutely giddy at the prospect of running such an AI and it won't be anything like a really smart human trapped in a computer.

Exactly this. I have met a number of people are extremely excited to witness the creation of a superintelligence, even at the expense of their lives, who if presented with a button to create a totally unrestricted AGI right here, right now, would press it in a heartbeat.

Re: AI Could Defeat All of Us Combined

#82

Post by 323 »

Barrin92 wrote: post #28

>So we should be worried about a large set of disembodied AIs as well. This is really the central issue and where these AI fears come from. It's tech workers being too infatuated with intelligence and mistaking it for power. A society of disembodied AI's is just the platonic fantasy version of a tech company full of nerds, and nerds never have power regardless of how smart they are. Anything that's digital is extreme…

> physical stuff you can just throw out of the window

This is like the chimps saying "don't worry about these evolving humans, we'll just keep them away from the bananas, look how weak they are".

Re: AI Could Defeat All of Us Combined

#83

Post by jessaustin »

bergenty wrote: post #70
asperous wrote: post #5

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple extension of weak ai, and it's hard to tell if it will arrive within our lifetime.

I don’t know, DeepMind just released a general purpose AI that should technically be able to help with anything. Who knows at what point that becomes indistinguishable from a human. I don’t know how the leap from running a program that has all the right answers to a conscious “being” with motivations happens though.

Supposedly anyone with a really good trading strategy will keep it to herself, because she'll make more money trading than selling investment advice. If that proposition is true, a similar proposition for AGI would be even more true. Therefore, it's hard to imagine that a well-run firm would ever offer AGI as a service for hire.

Re: AI Could Defeat All of Us Combined

#84

Post by lostmsu »

kelseyfrog wrote: post #53
germinalphrase wrote: post #42

Earlier quoted context omitted.

Our addiction to it. Our adoration of it. That we believe it is God. That we make ourselves more like it, less human.

The AI cults era is going to be so fun. Imagine a reinvention of the creation myth through the lens of an AI-aligned mystery religion. Absolutely wild.

And on the day 8 God created self.

Re: AI Could Defeat All of Us Combined

#85

Post by zwkrt »

sweetbitter wrote: post #81
kelseyfrog wrote: post #27

What a limited imagination of how an AI would take over. The scenarios seem to be centered around an extrapolation of "What if a really smart human were trapped inside a computer?" The amount of anthropomorphism is astounding. The author misses an even scarier prospect - people will want to run such an AI. They will be absolutely giddy at the prospect of running such an AI and it won't be anything like a really smart…

> The author misses an even scarier prospect - people will want to run such an AI. They will be absolutely giddy at the prospect of running such an AI and it won't be anything like a really smart human trapped in a computer. Exactly this. I have met a number of people are extremely excited to witness the creation of a superintelligence, even at the expense of their lives, who if presented with a button to create a to…

This makes Roko’s Basilisk very happy https://rationalwiki.org/wiki/Roko's_basilisk

Re: AI Could Defeat All of Us Combined

#86

Post by 323 »

nonameiguess wrote: post #61

The fact that so many apparently smart people earnestly worry about this really makes me feel like I'm missing something that should be obvious. I'm not going to claim real "expertise" in this kind of topic, but I'm far from clueless. My undergrad was in applied math, and though I went to grad school for CS, the focus was machine learning. It isn't what I ended up doing professionally, and I'm nowhere near up to date…

Why would you need to take over the army?

The simplest way to kill 80% of US population is just to shut down the electrical grid for two months or so.

Also, the army is commanded by the President. What if AI manipulates and puts his man into the office? Then he orders the army to hook the AI better into the systems :)

There are so many different scenarios, and you need to defend against all of them.

Re: AI Could Defeat All of Us Combined

#87

Post by lisper »

TheDudeMan wrote: post #75
lisper wrote: post #67

A much better movie than Terminator for exploring how AI can go wrong is Ex Machina: https://en.wikipedia.org/wiki/Ex_Machina_(film) If you're planning to watch it, don't read anything about it before you do, including the Wikipedia article linked above.

"If you're planning to watch it, don't read anything about it before you do" Good advice for all movies.

Yes, but this one in particular.

Re: AI Could Defeat All of Us Combined

#88

Post by Barrin92 »

323 wrote: post #82
Barrin92 wrote: post #28

>So we should be worried about a large set of disembodied AIs as well. This is really the central issue and where these AI fears come from. It's tech workers being too infatuated with intelligence and mistaking it for power. A society of disembodied AI's is just the platonic fantasy version of a tech company full of nerds, and nerds never have power regardless of how smart they are. Anything that's digital is extreme…

> physical stuff you can just throw out of the window This is like the chimps saying "don't worry about these evolving humans, we'll just keep them away from the bananas, look how weak they are".

but it's not at all like that because we're not AIs, chimps didn't hold any monopoly of force over us, and we're embodied beings. If we had evolved into talking Futurama heads we would indeed have a hard time against our chimp competitors regardless of our intellect. You throw Eliezer Yudkowsky into a cage with a chimp and my money is on the ape.

Re: AI Could Defeat All of Us Combined

#89

Post by sweetbitter »

ars wrote: post #41

The article gives a list 6 ways it could "defeat" humans, but doesn't bother explaining WHY an AI would do that. Why should an AI care about accumulating wealth or power? And AI is not a human, it doesn't have human drives and motivations. I can't figure out any reason why an AI would care about any of those things. At most it might want to reserve some computing power for itself, and maybe some energy to run itself.…

> The article gives a list 6 ways it could "defeat" humans, but doesn't bother explaining WHY an AI would do that. Why should an AI care about accumulating wealth or power?

Because there are people who think it would be amusing to tell it to do so?

Re: AI Could Defeat All of Us Combined

#90

Post by sweetbitter »

zwkrt wrote: post #85
sweetbitter wrote: post #81

Earlier quoted context omitted.

> The author misses an even scarier prospect - people will want to run such an AI. They will be absolutely giddy at the prospect of running such an AI and it won't be anything like a really smart human trapped in a computer. Exactly this. I have met a number of people are extremely excited to witness the creation of a superintelligence, even at the expense of their lives, who if presented with a button to create a to…

This makes Roko’s Basilisk very happy https://rationalwiki.org/wiki/Roko's_basilisk

Haha, perhaps. The only difference is that these fellows need not be threatened to realize their own passions.
Post reply on HN