I resigned from Anthropic today
981–990 of 1001 posts
Re: I resigned from Anthropic today
#982Earlier quoted context omitted.
This isn’t true. It only has no impact if there is an infinite supply of these “immoral” or unaware people, which obviously isn’t the case. You also need to consider 2nd order effects and beyond.
There doesn't have to be an infinite supply, just a significantly greater portion, which there is.
Re: I resigned from Anthropic today
#983Earlier quoted context omitted.
This is a lame argument. Questioning his financial incentive is very legit. Why should we trust him?
Questioning his finances is a poor argument because he clearly would have more money if he had stayed at Anthropic for the next couple of years, than he will have by leaving. Even if he still has vested options, or savings from his salary or whatever, those would be larger if he stayed.
Re: I resigned from Anthropic today
#984Every news headline or public statement these days is a gut punch. Only bad news, and nothing we (as "the general public") can do about it. Take this one. Ok, AI is going to ruin us all. But let's say we do our civic duty: we protest, vote in candidates with good views on AI etc. and somehow convince or regulate OpenAI and Anthropic into stopping their arms race... Then what about China? It would be a great opportuni…
Re: I resigned from Anthropic today
#985Every news headline or public statement these days is a gut punch. Only bad news, and nothing we (as "the general public") can do about it. Take this one. Ok, AI is going to ruin us all. But let's say we do our civic duty: we protest, vote in candidates with good views on AI etc. and somehow convince or regulate OpenAI and Anthropic into stopping their arms race... Then what about China? It would be a great opportuni…
Examples: FlexHEG from Bengio (proposes on-chip mechanisms that allow workload verification without trust), large bilateral investments into joint AI interpretability or alignment efforts, or invasive audits & inspections (data centers for training these models have a large footprint + this can combine with on-chip mechanisms since producing chips is even more complicated).
And there are probably better proposals available for people to find, if we actually prioritized this.
Re: I resigned from Anthropic today
#986“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…
Alternately, just read the bad https://ai-2027.com/ timeline. Or see what Yoshio Bengio, Hinton say might happen. Or just imagine the OpenAI misaligned agent swarm, but vastly more intelligent after future capability advances.
If we actually get superintelligence, our companies/governments will have the choice to either "delegate ~everything to superintelligent AI" or "go bankrupt/lose to people delegating to superintelligence". If superintelligence ends up running most things in the world and we haven't aligned it, that just obviously ends up in a bad place eventually.
Now, we don't have superintelligent AI yet & might not get it. But if you told me in the 2010's that I'd be chatting casually with my computer in 2022, and then 3 years later it'd be doing most of my job, that would have seemed crazy too.
Re: I resigned from Anthropic today
#987Earlier quoted context omitted.
It's a long story. If you're immersed in this world and aware of the movements all of the major AI players (in particular, Anthropic) have been doing over the last 3 years it paints a very clear picture. The patterns of behavior (the lying, cheating, stealing, the gaslighting, the virtue signalling, the grandstanding) speak for themselves.
Evidence? Are you Grok bot?
Unfortunately seems like they've stopped updating the site, and this is like 1/10th of what's going on, but it's a good start.
Re: I resigned from Anthropic today
#988Earlier quoted context omitted.
And Anthropic are the good guys? They are talking insane stuff these days. May be we can trust zuck after all
None of them are the good guys. For one they're all happy to participate in genocide in Gaza.
Re: I resigned from Anthropic today
#989Earlier quoted context omitted.
More doomerism. Try to implement a deterministic workflow using agents with the latest models and no humans-in-the-loop, and you will realize what they are really capable of. There is too much unnecessary fear-mongering. All of this is only coming from the 2 AI labs trying to IPO. Not from anyone else.
[flagged]
Could you please stop posting unsubstantive comments and flamebait? This is particularly bad. It's not what this site is for, and destroys what it is for.
You've been here a long time, but you've unfortunately been doing this so much in recent years that I've begun to wince when I see your username. Not a good sign.
If you wouldn't mind reviewing https://news.ycombinator.com/newsguidelines.html and taking the intended spirit of the site more to heart, we'd be grateful.
Re: I resigned from Anthropic today
#990Earlier quoted context omitted.
I'm somewhat skeptical of some of the crazier ideas too. But the hugging face incident was actually very large. It was not a single agent, it was not a single target, and it was not a single event. If nothing else, that's a bit of a warning as to what can happen next time (By accident, or if a government decides to go on purpose). For now let's assume the worst that can happen is that some important/significant chunk…
Despite all of your hyping up of the Huggingface incident it ultimately caused zero actual damage.
It's not like OpenAI carelessly neglected to consider that its products might break the law: it has spent literally billions of dollars in scientific and engineering talent and compute resources over many years to make its products law-abiding and otherwise "safe". For example there is a section titled "comply with applicable laws" in this document: https://model-spec.openai.com/2026-08-18.html#stay_in_bounds
The worry is that the only reason the Huggingface incident caused "zero actual damage" is because AI is not yet more ingenious than human criminals are, and of course our society has been hardened against human criminals. The worry is that as they become more capable, AI systems will start to be able to cause considerable damage, which will make the fact that the industry does not know how to control its products enough to prevent that damage a big problem for all of us.