Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI Could Defeat All of Us Combined

cold-takes.com

Post reply on HN
Print view View original

11–20 of 114 posts

Re: AI Could Defeat All of Us Combined

#11

Post by asperous »

asperous wrote: post #5

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple extension of weak ai, and it's hard to tell if it will arrive within our lifetime.

Another point adding on to this, is what if strong AI does reach the level of human intelligence, but is simply very slow? Such that a billion dollar machine is needed to match the thinking speed of one person? Perhaps this wouldn't be the case forever but I would say is a possibility for it at least at first.

Re: AI Could Defeat All of Us Combined

#12

Post by [deleted] »

asperous wrote: post #5

This doesn't mention AGI, which seems to be the prerequisite to this being a possibility. Despite impressive advances in "weak" ai, strong ai is not a simple extension of weak ai, and it's hard to tell if it will arrive within our lifetime.

[deleted]

Re: AI Could Defeat All of Us Combined

#13

Post by Jensson »

danuker wrote: post #8
tehsauce wrote: post #3

The moment a manufactured brain can do more mental labor than a human for less cost, it’s all over for humanity as we know it. Once that point is reached there’s no long-term sustainable arrangement where humans continue to exist, no matter how much effort we put into studying or enforcing AI alignment.

If you include computation under "mental labor", then it's all over already. If you include "automated trading", the AI allocates real-world resources where it sees fit (if the programming is not explicit).

Writing documents and emails and talking over a phone goes under "mental labor", it isn't very hard to imagine how most office jobs fits there etc.

Re: AI Could Defeat All of Us Combined

#14

Post by fullshark »

nathias wrote: post #9

AI in today's sense will become sufficient to provide corporations with more autonomy, people will do this to exploit other people, but the result will be humanity subjugated to AI. Some say this has already happened.

Or AI which no longer requires the gov't to have a willing and agreeable populace serve in its army to ensure control.

Re: AI Could Defeat All of Us Combined

#15

Post by marricks »

tehsauce wrote: post #3

The moment a manufactured brain can do more mental labor than a human for less cost, it’s all over for humanity as we know it. Once that point is reached there’s no long-term sustainable arrangement where humans continue to exist, no matter how much effort we put into studying or enforcing AI alignment.

Singularity enthusiasts have been saying that for 20 years. Even said we'd be there by know where we're obsolete.

Will technology put some, even many, folks out of a job? Sure of course, that's been happening for hundreds of years. Think of the blacksmiths of the 19th century who drank themselves to death.

And even at the end of it all, people still love the novelty of a human doing something. People still prefer "hand scooped" ice cream enough that it's on billboards.

Re: AI Could Defeat All of Us Combined

#16

Post by version_five »

lbj wrote: post #2

Another idea too dangerous to leave unchecked, like Nuclear weapons or Biological warfare. I think most people will agree that a GAI can't be bargained with, tempted, bought or otherwise contained - We will be at its complete mercy regardless of any constraints we might think up. What I would like to discuss, is how we can get humanity to a point where we can responsibly wield weapons that powerful without risking th…

> I think most people will agree that a GAI can't be bargained with, tempted, bought or otherwise contained - We will be at its complete mercy regardless of any constraints we might think up.

Who thinks this? I don't see any evidence that this is a common belief among people who work in the hard sciences related to AI, nor do I think it sound remotely logical

It feels like some people are taking archetypes like pandora box or genies or the Alien movies or some other mythology and using them to imagine what some unconstrained power would do if unleashed. That really has no bearing on AI (least of all modern deep learning, but even if we imagine that something leads to AGI that lives within our current conception of computers)

Re: AI Could Defeat All of Us Combined

#17

Post by revolvingocelot »

nathias wrote: post #9

AI in today's sense will become sufficient to provide corporations with more autonomy, people will do this to exploit other people, but the result will be humanity subjugated to AI. Some say this has already happened.

>the result will be humanity subjugated to AI. Some say this has already happened

Author Charles Stross ('cstross here on HN!) on corporations-can-be-described-as-AI:

https://www.antipope.org/charlie/blog-static/2019/12/artific...

Re: AI Could Defeat All of Us Combined

#19

Post by JamesBarney »

salt-thrower wrote: post #4

This type of thing used to scare me a lot more. But after the events of the last few years, the latest IPCC climate report, and the fact that AI has fallen on its face repeatedly despite expectations, I'm more convinced that we'll destroy ourselves before AI has the chance to take us out. But now that I think about it, the idea of a super intelligent AI simply waiting for humanity to die off naturally instead of goin…

Why does the latest IPCC climate report scare you so much? While we're still not on a great path the worst case scenario has gotten better.

Re: AI Could Defeat All of Us Combined

#20

Post by Jensson »

marricks wrote: post #15
tehsauce wrote: post #3

The moment a manufactured brain can do more mental labor than a human for less cost, it’s all over for humanity as we know it. Once that point is reached there’s no long-term sustainable arrangement where humans continue to exist, no matter how much effort we put into studying or enforcing AI alignment.

Singularity enthusiasts have been saying that for 20 years. Even said we'd be there by know where we're obsolete. Will technology put some, even many, folks out of a job? Sure of course, that's been happening for hundreds of years. Think of the blacksmiths of the 19th century who drank themselves to death. And even at the end of it all, people still love the novelty of a human doing something. People still prefer "ha…

> People still prefer "hand scooped" ice cream enough that it's on billboards.

This is a circular argument though, you say people prefer people and therefore we will have a lot of people around.

Today leaders and rich people requires humans to wage war and to produce goods, those are the main thing creating stability today. When those are removed we are likely to see a sharp decline in number of humans around. Companies cutting out humans and just using machines as leaders and decision makers outcompete humans in peace time, and robot lead armies outcompete humans in war times, and soon human companies or countries no longer exists.

Post reply on HN