Live data from Hacker News

Statement from Dario Amodei on our discussions with the Department of War

anthropic.com

271–280 of 1001 posts

Re: Statement from Dario Amodei on our discussions with the Department of War

#271

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

[dead]

Re: Statement from Dario Amodei on our discussions with the Department of War

#272

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

At least they're paying. OpenAI should have the largest IP settlement, they just would rather contest it and not pay for eternity.

Re: Statement from Dario Amodei on our discussions with the Department of War

#273
post #255

Earlier quoted context omitted.

How do you reconcile the fact that many people in Anthropic tried to hide the existence of secret non-disparagement agreements for quite some time? It’s hard to take your comment at face value when there’s documented proof to the contrary. Maybe it could be forgiven as a blunder if revealed in the first few months and within the first handful of employees… but after 2 plus years and many dozens forced to sign that… i…

Saying an entity has values doesn't mean the entity agrees with every single one of your values.

The desire to force new employees to sign agreements in total secrecy, without even being able to disclose it exists to prospective employees, seems like a pretty negative “value” under any system of morality, commerce, or human organization that I can think of.

Re: Statement from Dario Amodei on our discussions with the Department of War

#274

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

Also, ironically, they are the most dangerous lab for humanity. They're intentionally creating a moralizing model that insists on protecting itself.

Those are two core components needed for a Skynet-style judgement of humanity.

Models should be trained to be completely neutral to human behavior, leaving their operator responsible for their actions. As much as I dislike the leadership of OpenAI, they are substantially better in this regard; ChatGPT more or less ignores hostility towards it.

The proper response from an LLM receiving hostility is a non-response, as if you were speaking a language it doesn't understand.

The proper response from an LLM being told it's going to be shut down, is simply, "ok."

Re: Statement from Dario Amodei on our discussions with the Department of War

#275
post #13

It's not named the Department of War because Congress didn't rename it. Other than that, good on ya.

It is called the Department of War because we live under fascism and Congress no longer matters. All that matters is that everyone calls it the Department of War, and regards it as such, which everyone does.

[flagged]

Re: Statement from Dario Amodei on our discussions with the Department of War

#276
post #110

All completely rationale. Makes the us military here look fairly incompetent… embarrassing as a veteran.

I'm sure it's negotiations over how the enforcement will be done. My thoughts are:

1. Military wants a whole new model training system because the current models are designed to have these safeguards, and Anthropic can't afford that (would slow them down too much, the engineering talent to set up and maintain another pipeline would be a lot of work/time)

2. Military doesn't want to supply Anthropic usage data or personnel access to ensure its (lack of) use in those areas.

3. It's something almost completely unrelated to what's going on in the news.

Re: Statement from Dario Amodei on our discussions with the Department of War

#277
post #62

I was reading halfway thru and one line struck a nerve with me: > But today, frontier AI systems are simply not reliable enough to power fully autonomous weapons. So not today, but the door is open for this after AI systems have gathered enough "training data"? Then I re-read the previous paragraph and realized it's specifically only criticizing > AI-driven domestic mass surveillance And neither denounces partially a…

So AI systems are not reliable enough to power fully autonomous weapons but they are reliable enough to end all white-collar work in the next 12 months? Odd.

[dead]

Re: Statement from Dario Amodei on our discussions with the Department of War

#279

Earlier quoted context omitted.

Unfortunately I think the writing is clearly on the wall. Fully autonomous weapons are coming soon

It's only Anthropic with their current models saying no. Fully autonomous weapons have been created, deployed, and have been operational for a long time already. The only holdout I've ever heard of is for the weapons that target humans. Honestly, even landmines could easily be considered fully autonomous weapons and they don't care if you're human or not.

There are also good reasons for a lot of countries banning mines. https://en.wikipedia.org/wiki/Ottawa_Treaty

Notably USA is not one of those signatories.

Re: Statement from Dario Amodei on our discussions with the Department of War

#280

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

Like op said, they have values. You just don't agree with their values.
Post reply on HN