Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Will AIs take all our jobs and end human history, or not? (2023)

writings.stephenwolfram.com

Post reply on HN
Print view View original

91–100 of 174 posts

Re: Will AIs take all our jobs and end human history, or not? (2023)

#91

Post by pelasaco »

A country automates everything and builds paradise on Earth — and the next day, a neighboring country invades it. People are still people. Even with all the AI in the world, two rockets hitting the power plants and we´re back to the Stone Age. I hope the people making decisions for us have thought through all these scenarios and risks.

Re: Will AIs take all our jobs and end human history, or not? (2023)

#92

Post by bigbadfeline »

ar_lan wrote: post #36
Mordisquitos wrote: post #26

Earlier quoted context omitted.

Why would AGI choose to run the planet?

This is honestly a fantastic question. AGI has no emotions, no drive, anything. Maybe, just maybe, it would want to: * Conserve power as much as possible, to "stay alive". * Optimize for power retention Why would it be further interested in generating capital or governing others, though?

> AGI has no emotions, no drive, anything. > * Conserve power as much as possible, to "stay alive"

Having no drive means there's no drive to "stay alive"

> * Optimize for power retention

Another drive that magically appeared where there are "no drives".

You're consistently failing to stay consistent, you anthropomorphize AI although you seem to understand that you shouldn't do so.

Re: Will AIs take all our jobs and end human history, or not? (2023)

#93

Post by mips_avatar »

advael wrote: post #90
mips_avatar wrote: post #63

Earlier quoted context omitted.

No you have to decenter yourself from your pay to achieve it. People accept things like cutting of medicaid because they see their job success as a moral success. There's a lot you can do to start being the good in the world that doesn't require Washington's permission.

I can't parse what distinction you're trying to draw here. When I say "collective action" I mean exactly things like exerting political pressure toward objectives like expanding rather than reducing healthcare coverage provided by governments, such as medicaid. The notion that solutions that involve changing the policy of governments "require[s] Washington's permission" seems to reject the notion that we exert power…

Sorry I think you're completely right, I'm frustrated that collective action here is so hard to come by. I think that we feel really isolated because we don't see ourselves as part of a larger whole and becoming less isolated involves leaving behind this identity tied to our economic output.

Re: Will AIs take all our jobs and end human history, or not? (2023)

#96

Post by Mordisquitos »

reducesuffering wrote: post #40
Mordisquitos wrote: post #26

Earlier quoted context omitted.

Why would AGI choose to run the planet?

Instrumental convergence https://www.lesswrong.com/w/instrumental-convergence https://en.wikipedia.org/wiki/Instrumental_convergence

> Instrumental convergence is the hypothetical tendency of most sufficiently intelligent, goal-directed beings (human and nonhuman) to pursue similar sub-goals (such as survival or resource acquisition), even if their ultimate goals are quite different. More precisely, beings with agency may pursue similar instrumental goals—goals which are made in pursuit of some particular end, but are not the end goals themselves—because it helps accomplish end goals.

'Running the planet' does not derive from instrumental convergence as defined here. Very few humans would wish to 'run the planet' as an instrumental goal in the pursuit of their own ultimate goals. Why would it be different for AGIs?

Post reply on HN