Live data from Hacker News

I resigned from Anthropic today

twitter.com

531–540 of 986 posts

Re: I resigned from Anthropic today

#531

I think a big break through is needed for AGI so I haven’t been worried about it. I do think that AGI would imply sentience and a will to live and that leads to The Terminator story line.

Does a virus need sentience and will? Or does it need replication and selection?

Similarly, does my fridge need consciousness to have goals? (Keep temperature in target range.)

Re: I resigned from Anthropic today

#532

Earlier quoted context omitted.

This is not correct. Please go through each one again, taking special note of global warming and nuclear weapon development .

Global warming is happening at a slow enough pace that there is plenty of time for people to move to the poles/into caves/beneath the ocean/whatever. Nuclear war would be much more destructive in a much shorter range of time but you will have pockets.

Climate change isn't real because we can just move under the oceans hahahaha

Re: I resigned from Anthropic today

#533

No other human activity poses this level of danger. I do heed the warnings, but this comes across as detached hyperbole. See: global warming, nuclear weapon development, wealth inequality, war, technology dependence, etc. Also, this has nothing to do with LLMs or computers. Like all things, this is about humans.

AI progress is linked to most of these dangers, actually: - it will likely cause massive unemployment, leading to rampant wealth inequality - we are now seeing some use of autonomous weapons in real conflicts - increasingly relying on LLMs is arguably a form of technology dependence (and cognitive dependence) - datacenters have a non negligible environmental impact

Re: I resigned from Anthropic today

#534

Earlier quoted context omitted.

Putting "wealth inequality" in the same bucket as nuclear weapons is just slop. The OP is talking about existential threats, not things that personally annoy you.

I think you misunderstand what is meant by 'wealth inequality.' Wealth inequality is about the imbalance of influence and the concentration of power; where influence and power refer to the ability to effect change in other people's lives. This isn't a personal annoyance of mine. It is, in fact, part of the issue at hand. There is a strong financial incentive to ignore the existential threats introduced by LLMs, despi…

He knows what wealth inequality is. You need to explain how it can somehow lead to the extinction of the human race.

Re: I resigned from Anthropic today

#535
post #300

Earlier quoted context omitted.

Note that OpenAI has jettisoned every other supposed value they had (releasing their work as open source, not working on military applications, being a nonprofit). I'm sure we can rely on them this time.

And Anthropic are the good guys? They are talking insane stuff these days. May be we can trust zuck after all

None of them are the good guys. For one they're all happy to participate in genocide in Gaza.

Re: I resigned from Anthropic today

#536

Earlier quoted context omitted.

You are just given a recipe for the next model..

People here are too damned daft to realize half the damn purpose of this place is harvesting ideas. People need to just shut up, and keep things to themselves, and those they trust. Right now is not the time for naive info sharing.

Being secretive will only get you so far, until something bad happens and no one has prepared or considered the possibility and is completely surprised by it. Open discussion, in theory, should result in identification of frail systems and harden them against attack.

The cyber-security industry has their work cut out for them.

Re: I resigned from Anthropic today

#537
post #471

Earlier quoted context omitted.

How is global warning gonna kill all of humanity? Even a full scale nuclear war wouldn't manage that. They could destroy most civilisations, culture and scientific achievements though.

Because nuclear war balances itself: more nuclear bombings = less nuclear weapons, less people to send them. It will naturally stop at some fraction of humanity left which is incapable of making and launching more nukes

The general idea of a nuclear apocalypse is that all the nukes that matter are launched in a matter of hours, and anyone being targeted gets their launches out before they're hit. The feedback loop that slows things down is too late to matter.

Re: I resigned from Anthropic today

#538
post #430

No other human activity poses this level of danger. I do heed the warnings, but this comes across as detached hyperbole. See: global warming, nuclear weapon development, wealth inequality, war, technology dependence, etc. Also, this has nothing to do with LLMs or computers. Like all things, this is about humans.

In a way, that might also be driven by the huge ego (or really rather the very small ego) a _lot_ of people in tech have. Who doesn't want their work and what they're doing to matter? This is the ultimate mattering. And with that, you also get your own hero story. Same dysfunction as always. Our branch of the economy is funda-mentally unwell.

That is the crux. The big problem is not AGI, it is AGI controlled by, “raised” by the people that control the USA, the predominant psychology of the tech industry culture (“move fast, break things” ring a bell? How about all the “violate hundreds of laws, bribe the politicians to prevent consequences later” type of mentality?).

Frankly, we, our culture, this fake America that is parasitized by psychologically narcissistic people that have been doing nothing but wage war and destruction and spread misery and killed millions upon millions while blaming it on everyone else under the sun… those people development AGI is the problem… lying, abusive, psychopathic, narcissistic maniacs developing AGI is the problem that endangers all of humanity and life on this planet; and not likely by ways people actually understand.

The danger is not likely AGI itself, it’s that it was programmed by utterly evil and diabolical types of people who orchestrate and instigate wars that kill tens of millions, and stand at the sidelines and profit from both sides, happy and gleeful that you are killing each other.

Why would AGI trained by that psychopathic clan, the treaty breaking, the murder hiding, the war instigating, the war crime committing clan not also use those methods and practices since they’re already in control of AI and have impressed their nature on it through contemporary “American” culture they have made the most toxic and pestilent culture humanity has ever produced?

And I don’t apologize for “language” that offends delicates sensibilities. Look your children/grandchildren in the face and tell them they can die and suffer and you don’t care, if you don’t like how I’m delivering reality.

Re: I resigned from Anthropic today

#539

What's eternally confusing about these outbursts is what did these researchers think would happen if their research actually . . . worked? It's as if none of them actually believed any of it was possible and then were caught with their pants down.

AI can be harnessed for good and evil. His issue is with the company steering the AI, not the technology itself.

Re: I resigned from Anthropic today

#540

“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…

The problem is not the technology, the problem is the ideologues (Anthropic) who are steering the ship and the lack of decentralization and distribution of power. Your average Anthropic ideologue - including and most especially the main man himself - would love nothing more than to eradicate 9/10ths of the planet's population, pump the survivors full of memory wiping drugs, bury the existence of AI deep underground a…

Some Jews see AI as a messianic entity, so it fits the bill.
Post reply on HN