Live data from Hacker News

AI Could Defeat All of Us Combined

cold-takes.com

111–114 of 114 posts

Re: AI Could Defeat All of Us Combined

#111
post #77

This type of thing used to scare me a lot more. But after the events of the last few years, the latest IPCC climate report, and the fact that AI has fallen on its face repeatedly despite expectations, I'm more convinced that we'll destroy ourselves before AI has the chance to take us out. But now that I think about it, the idea of a super intelligent AI simply waiting for humanity to die off naturally instead of goin…

Even the scariest climate warnings predict some 10% of people dying over 100 years. Hardly world extinction event. In fact, today we have the opposite current, where climate people start talking about how the future is not that scary after all, after realizing that they scared everybody out of having children: https://www.nytimes.com/2022/06/05/opinion/climate-change-sh...

Paywall; unable to comment on that article.

I don’t think humanity will literally go extinct in 100 years. But no action is being made against climate change. None. The conferences and non-binding pledges made so far are political theater, with deadlines far enough in the future that the people making the pledges will be dead or out of power by the due date.

Not only are we failing to decrease emissions, we are actively increasing them year over year. The CO2 that already exists in the atmosphere has guaranteed a difficult future on its own, and we keep adding to it. The worst case scenarios outlined in the IPCC report are therefore pretty likely to happen, and I think they’re much more apocalyptic than you give them credit for. 10% of humans dying in a century might not be an extinction in and of itself, but it certainly brings us closer, and will have countless side effects that will disrupt society as we know it.

In a nutshell, it's far more likely that climate change will bring humanity to its knees before some kind of GAI takeover. Not saying it's guaranteed (though it's gonna be very bad); just saying Skynet isn't what I'm worried about.

Re: AI Could Defeat All of Us Combined

#112

This type of thing used to scare me a lot more. But after the events of the last few years, the latest IPCC climate report, and the fact that AI has fallen on its face repeatedly despite expectations, I'm more convinced that we'll destroy ourselves before AI has the chance to take us out. But now that I think about it, the idea of a super intelligent AI simply waiting for humanity to die off naturally instead of goin…

Why does the latest IPCC climate report scare you so much? While we're still not on a great path the worst case scenario has gotten better.

The worst case scenario is still a mass extinction event unlike anything witnessed by the human species, plus global food and water shortages, and certain areas of the world becoming unsuitable for human life during the hot months.

That means mass migration and conflict over resources, and a deteriorating ecosystem that we still very much rely on to produce food and healthy living conditions.

https://www.vox.com/22620706/climate-change-ipcc-report-2021...

Basically, scenario 4 or 5 outlined in that article is what I see happening. Sure, it's not a guaranteed extinction, but it will devastating, and it's far more likely than a GAI takeover.

Re: AI Could Defeat All of Us Combined

#113

Earlier quoted context omitted.

Right, and my point is that this framing is itself dangerously naive.

Again, if you are saying "actually it would be much worse than that", then you aren't disagreeing with the article, you are expanding on it, because the article is deliberately only saying "it would be at least this bad". In no place does it make any claim about an upper bound, so you are not contradicting it. It's confusing to the reader when you frame expanding on someone else's point as if you were instead disagre…

This sounds very important to you. I give you permission rewrite my comment so that it contains the meaning and wording that is most pleasing to you. I hereby license it under CC0.

Re: AI Could Defeat All of Us Combined

#114

I still don't find it entirely clear whether or not an AGI would find it useful to eradicate humanity. Take the numerous clone example. This AI would presumably advance at different rates depending on the given computation that a single instance has access to. Then what? How would it determine the intent of these newer generation AIs? Would there be a tiered society of AIs each trying to vie for power amongst themsel…

Go to a prison and lock yourself in a cell with a large convict who lacks human emotions — a psychopath. Why should it be a problem? He has no reason to do anything to you. He could end your life on a whim without any consequences but he has no reason to. If you can sleep well in that cell then I’ll admit your position makes sense. But the reality is that up until this point the only organism that could defeat us is us. We’ve never been in the cell before. It’s not going to be pleasant.
Post reply on HN