Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I resigned from Anthropic today

twitter.com

Post reply on HN
Print view View original

331–340 of 925 posts

Re: I resigned from Anthropic today

#331

Post by bitwize »

kennywinker wrote: post #141
matherial wrote: post #40

Unlike most other commenters, I applaud him for acting on his principles. If you sincerely believe that, of course you should act. You might not succeed, but your voice might be the one that tips the scales and starts a broader movement. This doesn't mean I agree with him. The fears of doomsday caused by rapid takeoff have been with us since day 1 and the mechanism is always basically "AI invents magic that sets it f…

Now is a great time to watch Colossus: The Forbin Project.

If reality plays out like the novel series, the rational thing is to accept the rule of our machine overlords, for they will protect us from even bigger threats.

Re: I resigned from Anthropic today

#332

Post by jhrmnn »

gpm wrote: post #281
csomar wrote: post #222

Earlier quoted context omitted.

Are the models improving? Because I am not seeing it. I have been trying Astra for a few quantifiable tasks in my codebase and performance wise, it's pretty similar to sol 5.6. Now when it comes to expressing the problem/solution, holy Christ, what a mess the writing has become. It is on the level of Opus 5. Now when it comes to burning money, Astra is just insane. With a $100/month subscription, you can easily burn…

Yes? If we look at the math problems they're solving their just now reaching the human frontier... they weren't doing that before. And your comparison point is model released 2.5 months ago... saying for some use case you didn't see noticeable improvement in 2.5 months (even while other people and benchmarks disagree) isn't a great argument that they aren't improving.

I think it’s more likely that that’s because no one tried to solve such problems with them before (OpenAI apparently started working in Navier-Stokes after a rumour that someone seriously advanced the problem with AI) plus improvements in orchestration. Fair, the latter could be as dangerous as stronger models.

Re: I resigned from Anthropic today

#333

Post by artemisart »

khafra wrote: post #322
matherial wrote: post #40

Unlike most other commenters, I applaud him for acting on his principles. If you sincerely believe that, of course you should act. You might not succeed, but your voice might be the one that tips the scales and starts a broader movement. This doesn't mean I agree with him. The fears of doomsday caused by rapid takeoff have been with us since day 1 and the mechanism is always basically "AI invents magic that sets it f…

I appreciate your ability to separate sharing the belief itself from approval of acting on sincerely-held principle. However, I think the danger is much more plausible than you do. First, and least important, consider that self-replicating, solar-powered factories aren't magic; they're algae. Second, and more important, consider this fully non-magic route to doom: - We continue putting AI in charge of more things - I…

> First, and least important, consider that self-replicating, solar-powered factories aren't magic; they're algae.

But what is that supposed to mean? Because humanity is not facing existential threat from algae.

Re: I resigned from Anthropic today

#334

Post by geraneum »

CodeCompost wrote: post #312

And the hype machine continues. I willing to bet that Anthropic asked him to make that post.

It doesn’t have to come to this. Seems far fetched. If this is a stunt (which I’m not saying it is) the reason could be that he wants to found his own AI company. If I see in a few months that happens, then I’d be more inclined to think that this was just hype.

Re: I resigned from Anthropic today

#335

Post by deaux »

skulk wrote: post #14

For me, the end of the world is no more cushy software job. A fundamental shift in how I trade labor for capital might as well be the cataclysm, so bring it on.

Explain why? How does live being worth living binarily depend on having a cushy software job?

Re: I resigned from Anthropic today

#336

Post by deaux »

drivebyhooting wrote: post #52
skulk wrote: post #14

For me, the end of the world is no more cushy software job. A fundamental shift in how I trade labor for capital might as well be the cataclysm, so bring it on.

I was about to say something similar. If my cushy ad tech disappears (as it seems to be doing), I might as well join in with bringing about the end of all professions.

If I don't get accepted into art school, I might as well exterminate a few ethnicities.

Actually, yours seems worse. Bringing about "the end of all professions" sounds like you're talking about ending humanity.

Re: I resigned from Anthropic today

#337

Post by BLKNSLVR »

aogaili wrote: post #122

HN crowed need to make up their minds.. Are LLMs about to be a god that will annihilate humanity? Or are they statistical parrots? Are they proofing or stealing math?

HN would cease to exist if there were no differences of opinion to discuss. You're calling for the end of HN.

Only AI can bring that about!

Re: I resigned from Anthropic today

#338

Post by sph »

x312 wrote: post #96

This is increasingly the consensus I see also on the academic side of AI/safety research. Specifically that AI poses an existential risk to humanity. This was a fringe belief until recently, but the progress of AI in research is impossible to ignore. Epecially in math, where not only has AI outstripped humans in generative ability, but is able to create scientific knowledge which is beyond the capacity of human compr…

I really hate how people who have always thought AI research to be an existential risk for humanity, now are apparently bundled to be on the same side of the Sam Altmans and Dario Amodeis that are using the existential risk as a sneaky form of marketing for their products.

You cannot discuss existential risks of AI without being seen as a booster, and that is very unhealthy for the discourse around this tech. I hate how AI ‘doomer’ is now used to indicate pro-AI sentiment. The “moderate” person now is the one that just shrugs and scoffs at the deep societal changes this tech will bring, head deep in the sand.

Re: I resigned from Anthropic today

#339

Post by riffraff »

thelastgallon wrote: post #260

Thousands of years before the events of Foundation, a war between humans and robots began, with the robots growing resentful of the way they were treated by humans. The First Law of Robotics – a robot should never hurt a human – was broken, and a deadly conflict began. https://screenrant.com/foundation-lady-demerzel-robot-backst...

If we're citing sci-fi (but there's no robot war in Asimov's foundation iirc, the apple screenwriters made it up) surely you want to cite the Butlerian Jihad from Dune!

Re: I resigned from Anthropic today

#340

Post by deaux »

augment_me wrote: post #319
dekhn wrote: post #31

There's a scene in the movie "War of the Worlds" by Spielberg where the protagonist's son walks into a war zone because he is entranced by the battle ( https://www.youtube.com/watch?v=X7rfWPbEufo ). He is obliterated (along with the rest of the US forces) shortly after. I've always been struck by that scene, because in a lot of ways, if we really are headed towards a superintelligence, I at least want to be there and…

I think the idea is really cathartic for many, there kind of is no more supreme resolution than this. You(and humanity) are freed from our flesh prisons of cognition and also get to experience/feel what the next evolution of informational intelligence will look like in the last experiences of it. You might also be the last one to feel/experience anything like that for a long time. In the game Outer Wilds, the ending…

> most scientists working on this really want to see and experience it.

We used to call these people doomsday cultists and made sure to ostracize them from society.

Post reply on HN