Live data from Hacker News

I resigned from Anthropic today

twitter.com

931–940 of 978 posts

Re: I resigned from Anthropic today

#931

Earlier quoted context omitted.

I am not rewriting. I am saying AI is not more dangerous in my opinion that Nuclear Weapons.

You are wrong. A teenager with enough GPUs could never dream of making a nuke but they are absolutely able to run capable AIs in their moms basement. Totally different class of danger

And do what with it ?

Re: I resigned from Anthropic today

#932
post #440

“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…

Do you think people should continue developing AI up until the point that there is evidence that AI is facilitating biological weapons development? I think we should stop before then. But that necessarily means that there will not be evidence at the time that we stop.

We also need to stop before the AI opens a portal to hell. There's no evidence of that happening... but by the time there's any indication it's possible, it's too late.

Re: I resigned from Anthropic today

#933

I’m not advocating for this. ~~~~~~ If you really believed these labs were going to result in the extinction of humanity and you saw it first hand, don’t you have a moral obligation not to quit your job but to go and try and kill everyone working on said project, blow it up, or otherwise stop it? I take these resignations with a grain of salt precisely for that reason. If I worked at a job and I saw some crazy guy or…

> I’m not advocating for this. You're not advocating for it because murdering people is highly immoral and illegal. That answers your question for the most part. You also have to remember that the magnitude and speed of this stuff is very new to pretty much everybody . It's not exactly trivial to go from "I'm just doing my job" to "I need to kill everybody in my company to save the world" in a year or two, especially…

This is a non sequitur. Yes, if someone doesn't actually believe in imminent AI doomsday they are not going full Sarah Connor on Anthropic. Yes, HN will not like if someone pipe bombs the office. What does it have to do with @ericmay's point?

He directly says "They are racing straight to self-improving superintelligence and gambling with our lives", that's a claim of imminent threat to humanity. If he truly believes that, direct action shouldn't be off the table nor even be immoral. Obviously he might not have the temperament or simply be a pacifist, that's totally normal but the point is that tweets are weird even then.

Why just make some tepid tweets if you think humanity is at risk? Why doesn't he leak documents and messages with the unfiltered opinions of leadership? Why isn't screaming "we are going to die" in CNBC? You'know, try anything?

That's where the "take it with a grain of salt" is important, maybe this is just a jumping point to a better job in the next super safe AI lab (for realsies this time)

Re: I resigned from Anthropic today

#934

Earlier quoted context omitted.

How so?

It's a long story. If you're immersed in this world and aware of the movements all of the major AI players (in particular, Anthropic) have been doing over the last 3 years it paints a very clear picture. The patterns of behavior (the lying, cheating, stealing, the gaslighting, the virtue signalling, the grandstanding) speak for themselves.

Evidence? Are you Grok bot?

Re: I resigned from Anthropic today

#935
post #691

Earlier quoted context omitted.

The drones are obviously very important but they only work in the context of everything else on and around the battlefield, especially people. You aren't holding the line with drones alone, and on the whole they are not autonomous.

They are holding the lines with drones alone nowadays. That's why it's called the deathzone, no humans survive. Some drones have FPV operators, some weapons use AI only already.

I think you're painting a slightly misleading picture. The drone AI, computer vision and autonomous fire-control systems existed (and were used in combat) before LLMs/AI was a hot topic.

There are applications of modern LLMs and recent AI advances on the front-lines, but they are not the majority contributor to enforcing the death zone. Without modern LLMs, I would bet that the frontlines would look very similar to how they are today.

Re: I resigned from Anthropic today

#936
post #620

Earlier quoted context omitted.

The mathematics research results are certainly impressive, but I don't see what that has to do with robotics. Waymo is getting somewhere, but it's been a long slog. There doesn't seem to be much progress on, say, package delivery. For more, see: https://secondthoughts.ai/p/14-reasons-robotics-is-hard

Didn't you follow the robotics advances in the Ukrainian - Russian battlefield? There is now a death zone of 50km, only controlled by drones and automatic weapons.

Those drones can only stay up for a few hours at most. Then they need refueling and relaunch, with plenty of human-only steps.

Even if you have terminator-style AI uprising, all you need to do to be safe from those drones is to wait a day.

(The automated weapons can probably last longer, but they still need electricity, and there are still a lot of human steps there)

Re: I resigned from Anthropic today

#938

Earlier quoted context omitted.

I'm somewhat skeptical of some of the crazier ideas too. But the hugging face incident was actually very large. It was not a single agent, it was not a single target, and it was not a single event. If nothing else, that's a bit of a warning as to what can happen next time (By accident, or if a government decides to go on purpose). For now let's assume the worst that can happen is that some important/significant chunk…

> For now let's assume the worst that can happen is that some important/significant chunk of (transitively) internet connected stuff goes haywire all at once. That's probably your upper limit of what can go wrong for now. If we have to disconnect from the internet to stop some kind of mold outbreak, we can't get the weather or transfer money or access healthcare or teach an elementary school class or buy stuff from s…

Elementary school dont need internet at all. You can happily live without weather app. Most of healthcare does not require internet, altrought the organization would be lwss effective.

So, you are loosing transfers, basically.

Re: I resigned from Anthropic today

#939

“ No other human activity poses this level of danger.” I really, really disagree with that statement. I don’t think ai models come close to nuclear weapons or to run-of-the-mill, everyday carbon emissions in terms of danger to humanity. What’s the most dangerous thing that’s happened with an LLM so far? (This question is serious - maybe I don’t know the right examples.) Example 1: I’m aware of a small number of peopl…

Nuclear Weapons is a great example because, unlike AI, it is a real and present danger. Civilization could be catastrophically diminished, if not completely wiped out, literally today.

Re: I resigned from Anthropic today

#940

Earlier quoted context omitted.

Past changes to economic relationships haven't replaced labor either, yet they have led to conflict and starvation. You are setting an incredibly high bar here, essentially a strawman. If people feel disenfranchised due to their diminishing political and economic power, there will be enormous potential for conflict. This is a pattern across history and central to all the economics I've ever read. As an economist, do…

Is the core of your argument that the industrial revolution and other such changes should have been aborted due to their downstream negative affects? They also lead to great advancements in quality of life, and the capability of sustaining much more human life. We can't predict the long term outcome of new technologies, so the best we can do is blindly forge ahead and try to mitigate the obvious short term problems.

Yes, industrial revolution should have been managed differently and yes the world would be better if it was.
Post reply on HN