Live data from Hacker News

Statement from Dario Amodei on our discussions with the Department of War

anthropic.com

851–860 of 1001 posts

Re: Statement from Dario Amodei on our discussions with the Department of War

#851
This also helps build Anthropic hype.

There are military officials saying they need anthropic because it is so good. They can't live without it.

All of this really helps Anthropic.

Its good publicity for them. And gets the military on record saying they are so good they are indispensable. And they can still look like the good guys for resisting, because they were forced.

Re: Statement from Dario Amodei on our discussions with the Department of War

#852

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

just curious, what about other regions and countries who have no such restrictions to develop their weapons? there is no world treaty on this yet, even there is one, not everyone will follow behind the doors.

Re: Statement from Dario Amodei on our discussions with the Department of War

#853
post #844

Something feels off about this announcement. Anyone else? Credit where it's due, going on record like this isn't easy, particularly when facing pressure from a major government client. Still, the two limits Anthropic is defending deserve a closer look. On surveillance: the carve-out only protects people inside the US. Speaking as someone based in Europe, that's a detail that doesn't go unnoticed. On autonomous weapon…

>the carve-out only protects people inside the US. Speaking as someone based in Europe, that's a detail that doesn't go unnoticed. I'm not sure an American company prioritising the privacy of American people is worth questioning. As a European, Anthropic are very low on the list of companies I worry about in terms of the progressive eradication of my privacy.

Agreed. That said, Anthropic's original pitch was about embedding safety at the foundational level of the 'model' (acknowledging that a model is more than just its weights).

If the safeguard against mass surveillance is strictly tied to geolocation (US vs. non-US), it can't be an intrinsic property of the model. It has to be enforced at the API or contractual level. This means international users are left out of those core, embedded protections. Unless Anthropic is planning to deploy multiple, differently-aligned foundation models based on customer geography or industry, the safety harness isn't really in the model anymore.

Re: Statement from Dario Amodei on our discussions with the Department of War

#855

Earlier quoted context omitted.

What else would you expect? The military is obviously going to develop the most powerful systems they can. Do you want a tech company to say “the military can never use our stuff for autonomous systems forever, the end”? What if Anthropic ends up developing the safest, most cost effective systems for that purpose?

Yes, that's exactly what I want them to say.

No, you don't. If they develop the safest, most cost-effective version of the technology that the military WILL inevitably use from some company, Anthropic or otherwise, then that's the version of this tech you want them using.

Re: Statement from Dario Amodei on our discussions with the Department of War

#858

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

> driven by values

So what? Every business is driven by values.

Re: Statement from Dario Amodei on our discussions with the Department of War

#859
post #358

Earlier quoted context omitted.

More like the government is treating this like the near term weapon it actually is and, unlike the Manhattan project, the government seems to have little to no control.

Anthropic has been pushing for commonsense AI regulation. Our current administration has refused to regulate AI and attempted to prevent state regulation. "The government doesn't have control of this technology" is an odd way to think about "the government can't force a company to apply this technology dangerously."

Because of Bernstein v DOJ, any AI company in the 9th circuit cannot be regulated because software is considered free speech.

Re: Statement from Dario Amodei on our discussions with the Department of War

#860

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

There's a simpler explanation than "billionaires with hearts of gold" here. If: (1) this is a wildly unpopular and optically bad deal (2) it's a high data rate deal--lots of tokens means bad things for Anthropic. Users which use their product heavily are costing more than they pay. (3) it's a deal which has elements that aren't technically feasible, like LLM powered autonomous killer robots... then it makes a whole l…

All excellent points to add to the motivation to hold the line just where it has been.
Post reply on HN