Live data from Hacker News

Pausing AI Developments Isn't Enough. We Need to Shut It All Down

time.com

411–414 of 414 posts

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#411
post #174

This is ridiculous. His partner should already be having reservations seeing their daughter lose a tooth in a world with dying oceans, plastic in everything, increasing disparity and rise of authoritarianism, nuclear proliferation, etc. How are humans solving those issues? We're already dead, we just don't know it yet. We're walking around with a terminal diagnosis and we just keep ignoring the doctor's calls pretend…

I deeply disagree with putting the existential risk of AGI on a level with pollution, climate change or war.

If you exclude nuclear war, all of these things happen at a human timescale and accelerate fairly slowly and thus can be counteracted.

In many ways GPT already hugely exceeds human speed and bandwith and scaling this up is likely to be self-accelerating if we allow for it. Also there is a huge individual incentive to play with the fire here while the negative externalities could cause effective wipeout - which is why it's commonly equated with commodification of nuclear weapons.

Even if you're deeply pessimistic about the ramp-up, the economic shock of what was already released could still increase political volatility to a point where the likelyhood of wipeout by war becomes significant again.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#412

Earlier quoted context omitted.

What was that quote... "Provably unfriendly natural intelligence wants to build unprovably friendly artificial intelligence"

"Demonstrably unfriendly natural intelligence seeks to create provably friendly artificial intelligence."

That's the one. Are classifieds still a thing? It reads like one of those.

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#413

I find funny to see how many people become luddites when the technical progress finally menace them

Yudkowsky has been saying all this for decades

I don't know him, I will have a look thanks

Re: Pausing AI Developments Isn't Enough. We Need to Shut It All Down

#414
Oh yes. This entire venture is something only the most foolish of geniuses thinks will end well. Almost every prior invention in the history of humanity was supposed to improve things. Some people got major quality of life boosts and other people still live in squalor, because people don't quit being human, but we can automate the humanity out of them, or "rise above" humanity via computer code embedded with human values, even the evil ones, and not just math. This will end horribly. Hopefully horribly enough that this idiotic worldview gets burned out of the collective consciousness of whatever survivors remain, so that no one makes that mistake again, but I doubt we'll be so lucky. Best hope to hit energy limits, and soon.
Post reply on HN