Live data from Hacker News

Humanity isn't ready for the coming intelligence explosion

economist.com

351–360 of 524 posts

Re: Humanity isn't ready for the coming intelligence explosion

#352

Can these snake oil salesmen stop with this Sci-fi stuff please? Yes, Machine learning, and transformer architecture are great stuff, but lets not pretend this is sci-fi, please.

This is absolutely sci-fi.

ChatGPT and Claude are literally building staging scripts for me as I type this.

5 years ago, few people on this planet would have thought the computer would make advanced POSIX compliant shell scripts, but here we are.

Re: Humanity isn't ready for the coming intelligence explosion

#353
post #257

There's issues where bad people with bad intentions use AI to do bad things. But to an extent the guardrails already built-in are sufficient. The real danger in AI is how it impacts society, our economy, and our perception of self worth. I'm not afraid of rouge agents nearly as much as I'm afraid of us building a permanent underclass of people dependent on whatever scraps the people who devalued their labor decide th…

The world is in a crisis of trust. We are losing faith in each other. AI has further undermined that trust; audio and video recordings can no longer be trusted like they once were. The impact is still being felt. It takes longer to build than destroy. Not just trust. Anything. The lack of trust has created friction for everything; more regulations, deeper background checks, purchasing goods and services… the list goe…

The problem is that we've replaced tribal trust networks with increasing systemization and the more of that we build the more brittle the whole thing gets. We have a global society that is more complex and interdependent than ever before. We've set ourselves up for a kind of economic Kessler syndrome and we're gleefully adding more layers to it.

Re: Humanity isn't ready for the coming intelligence explosion

#355

Earlier quoted context omitted.

Why would they listen to an AI, when their favorite podcaster says something contrary? I am not trying to be funny btw, people take medical advice from podcasters over doctors. I have seen this first hand.

AI can presumably make a preferable podcast no problem.

I think that might get the distribution backwards. Why trust these SV elites, when I have ____? He/she gets me!

If anything, people with large audiences are going to give "custom" AIs to their followers.

I hope I am wrong.

Re: Humanity isn't ready for the coming intelligence explosion

#356

Earlier quoted context omitted.

And Americans' lives have been heavily shaped by cars and the car industry in a negative way. So, a pretty apt comparison.

And despite all the deaths they caused, the benefits are undeniable... Fancy going back to horse and cart? Didn't think so...same logic applies to ai

Horse and cart, no. But some cities have banned cars and replaced them with various alternatives, and it works.

There are alternatives to the car culture we have. It would require significantly rebuilding how we build infrastructure, but the result could be much safer, cleaner, and less stressful.

Of course Americans would rather die, but counties of sane people might be able to work it out.

Re: Humanity isn't ready for the coming intelligence explosion

#357

Earlier quoted context omitted.

And Americans' lives have been heavily shaped by cars and the car industry in a negative way. So, a pretty apt comparison.

And despite all the deaths they caused, the benefits are undeniable... Fancy going back to horse and cart? Didn't think so...same logic applies to ai

First off, you don't know if duskdozer doesn't want to go back to cart and horse. Second even if they don't there's an enormous amount of space between horses and https://parkingreform.org/resources/parking-lot-map/ a third of my downtown being parking lots, downtown which is already the dense bit.

Re: Humanity isn't ready for the coming intelligence explosion

#358
post #216

Earlier quoted context omitted.

To be honest, I don't believe it is a any more crazy believe than all of the other religions. But practitioners there might have a bit more respect for existing things and not mindlessly crush because they can, so I actually like the concept a bit. But I assume it can also set foundation for some exhausting debates .. "can we really move that random rock to build a house with?" but as far as I understood the practica…

> To be honest, I don't believe it is a any more crazy believe than all of the other religions. The only way anyone can make a blanket statement like that and put "all religions" on equal epistemic footing is through ignorance of their deep differences. Even the word "religion" as commonly used today is relativistic by assumption , which is likely the source of how we commonly perceive "religion". A consequence of th…

"The only way anyone can make a blanket statement like that and put "all religions" on equal epistemic footing "

All religion is based on superstitious believes, or do you have counter examples? But I am already quite familiar with the catholic church in particular and do not think they are a counter example in the slightest.

Re: Humanity isn't ready for the coming intelligence explosion

#359

Earlier quoted context omitted.

And Americans' lives have been heavily shaped by cars and the car industry in a negative way. So, a pretty apt comparison.

And despite all the deaths they caused, the benefits are undeniable... Fancy going back to horse and cart? Didn't think so...same logic applies to ai

The car did not replace the horse and cart. This is an oft cited and widely believed myth. It replaced mostly walking, but also cycling, trollies and trains. And it didn't do so until after a huge build out of infrastructure to accommodate drivers at the cost of everything else.

After the building of highways and roads cities were no longer walkable, people had moved out into the suburbs, their jobs were now a couple of towns over and they couldn't even walk to the grocery store. Cars enabled that, but politicians and capitalist were the ones who did that.

Re: Humanity isn't ready for the coming intelligence explosion

#360
post #257

There's issues where bad people with bad intentions use AI to do bad things. But to an extent the guardrails already built-in are sufficient. The real danger in AI is how it impacts society, our economy, and our perception of self worth. I'm not afraid of rouge agents nearly as much as I'm afraid of us building a permanent underclass of people dependent on whatever scraps the people who devalued their labor decide th…

> There's issues where bad people with bad intentions use AI to do bad things. But to an extent the guardrails already built-in are sufficient. The real danger in AI is how it impacts society, our economy, and our perception of self worth.

I agree with you those dangers exist, but you seem to have ignored the specific threat described in the article, from a superintelligence capable of manipulating human beings indetectably, where we'll be at its mercy and only able to hope it's fully aligned with humanity's interests. The risks you describe are grave, though - especially economically, if governments don't grow to outmuscle the power of the oligarchal owners of these systems, which seems wholly unlikely at the moment in the West, with its neoliberal orthodoxies.

Post reply on HN