[deleted]
Anthropic researcher says more than 10% chance AI "could kill all humans"
31–40 of 112 posts
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#32If it does it will be at the hands of another human. AI to me is like the Nuclear race again. Super powers will be using it as a super weapon. I don't think AGI will wipe us out by itself.
I’m not so sure on this, the hugging face incident showed that a relatively benign task can make it do quite destructive things in the name of optimizing a relatively benign goal.
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#33This is the most perverse marketing campaign in history. "Our product might wipe out all of human civilization". It is said that heavily regulated industries earn that regulation. Seems like the LLM folks really want that regulation.
How is it marketing if it's from someone who just quit in objection?
it's not marketing. it's an internal culture (emphasis on cult) that's high in its own supply.
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#34I'd like to know how these people arrive at their estimates. Why 10% and not 1% or 50%?
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#35> Superintelligence is the still-theoretical notion of an AI agent that is smarter than even the sharpest human minds.
When are we supposed to see this materialize?
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#36If they actually believed this they'd be buying a truckload of fertilizer and diving it to the nearest chip fab. I don't buy it.
What... I think you might be sharing more about your internal psyche here than providing some generalized commentary on this story. Why would you need to bomb a chip fab because you think AI might lead to people getting killed in the future? I'm convinced of many things killing humans, yet I don't have any desire to bomb or kill others, I think this is pretty common, but who knows....
You’re likely taking this too literally. OP is saying that beliefs inspire action, but as of now we haven’t seen action from these people that support such an extreme belief.
What we have seen is incredible hype (justified or not), so it’s more likely just a continuation of that.
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#37> AI "could kill all humans"
After all the decades of work we've put into orchestrating our own demise through climate change, here comes AI to steal another human job.
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#38I’ve yet to see a rational argument for how we go from super intelligent LLMs to human extinction or extermination. I understand that some smart people are worried about it. I just haven’t come across a believable or understandable argument.
If we get RSI, here soon humans will be economically irrelevant.
At that point, we will likely be slowing down the growth of capitalism (through mass resistance, global warming, etc). One thing AI will likely be aligned on is the growth of capitalism. If it views humanity as a threat for that, why would it not eliminate that threat?
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#39If it does it will be at the hands of another human. AI to me is like the Nuclear race again. Super powers will be using it as a super weapon. I don't think AGI will wipe us out by itself.
more likely an incompetent administration puts it in charge of military infrastructure and capabilities it shouldn't
Re: Anthropic researcher says more than 10% chance AI "could kill all humans"
#40The real source of concern perhaps is the 90% chance AI is used to kill 90% of humans. Just crash the global economy and supply chains and see how quickly major metro areas run out of food and gas.
And as someone else pointed out, it will almost certainly be at the intentional direction of a human or humans, not the paper clip maximizer.