Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Statement from Dario Amodei on our discussions with the Department of War

anthropic.com

Post reply on HN
Print view View original

441–450 of 1001 posts

Re: Statement from Dario Amodei on our discussions with the Department of War

#441

Post by exabrial »

huevosabio wrote: post #423
exabrial wrote: post #416

Brother in law did some "time with the brass" as he calls it. His take was that the DOD, er DOW would, as an example, never acquire a fighter jet that "wouldn't target and kill a civilian airliner", citing that on 9/11 we literally almost did that. The DOW is acquiring instruments of war, which is probably unconformable for a lot of people to consider. His conclusion was that the limits of use ought to be contractual…

The pentagon had already agreed to Anthropic's terms and wants to walk back. It can always find some other supplier if it wishes to.

I think that's the nuance:

* agreeing to the terms - one subject

* having to the tool attempt to enforce said terms - another subject

Re: Statement from Dario Amodei on our discussions with the Department of War

#442

Post by mandeepj »

jjcm wrote: post #155

This is the strongest statement in the post: > They have threatened to remove us from their systems if we maintain these safeguards; they have also threatened to designate us a “supply chain risk”—a label reserved for US adversaries, never before applied to an American company—and to invoke the Defense Production Act to force the safeguards’ removal. These latter two threats are inherently contradictory: one labels u…

First of all, there's no such thing as "Department of War". A department name change is legal/binding only after it's approved by the Senate. Senator Kelly is still calling it DoD (Department of Defense).

> Mass domestic surveillance.

Since when has DoD started getting involved with the internal affairs of the country?

https://en.wikipedia.org/wiki/United_States_Department_of_De...

Re: Statement from Dario Amodei on our discussions with the Department of War

#444

Post by xpe »

biddit wrote: post #274
bnr-ais wrote: post #252

Earlier quoted context omitted.

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

Also, ironically, they are the most dangerous lab for humanity. They're intentionally creating a moralizing model that insists on protecting itself. Those are two core components needed for a Skynet-style judgement of humanity. Models should be trained to be completely neutral to human behavior, leaving their operator responsible for their actions. As much as I dislike the leadership of OpenAI, they are substantially…

> Also, ironically, they are the most dangerous lab for humanity.

Show us your reasoning please. There are many factors involved: what is your mental map of how they relate? What kind of dangers are you considering and how do you weight them?

Why not: Baidu? Tencent? Alibaba? Google? DeepMind? OpenAI? Meta? xAI? Microsoft? Amazon?

I think the above take is wrong, but I'm willing to listen to a well thought out case. I've watched the space for years, and Anthropic consistently advances AI safety more than any of the rest.

Don't get me wrong: the field is very dangerous, as a system. System dynamics shows us these kinds of systems often ratchet out of control. If any AI anywhere reaches superintelligence with the current levels of understanding and regulation (actually, the lack thereof), humanity as we know it is in for a rough ride.

Re: Statement from Dario Amodei on our discussions with the Department of War

#445

Post by tempestn »

alangibson wrote: post #4

It's not named the Department of War because Congress didn't rename it. Other than that, good on ya.

The name is extremely off-putting, but I can see how they would want to be diplomatic toward the administration in using their chosen name. Save the push-back for where it really matters.

Re: Statement from Dario Amodei on our discussions with the Department of War

#446

Post by rl3 »

taurath wrote: post #439
neom wrote: post #319

Earlier quoted context omitted.

I've had so much abuse thrown at me on here for saying this very thing over the last few years. I used to be friends with Jack back in the day, before this AI stuff even all kicked off, once you know who people really are inside, it's easy to know how they will act when the going gets rough. I'm glad they are doing the right thing, but I'm not at all surprised, nor should anyone be. Personally I believe they would go…

> it's easy to know how they will act when the going gets rough Even if you went to burning man and your souls bonded, you only know a person at a particular point in time - people's traits flanderize, they change, they emphasize different values, they develop different incentives or commitments. I've watched very morally certain people fall to mania or deep cynicism over the last 10 years as the pillars of society s…

>Even if you went to burning man and your souls bonded ...

I'll take: List of places I never want to bond my soul with someone at for one thousand, please.

Re: Statement from Dario Amodei on our discussions with the Department of War

#447

Post by reasonableklout »

bnr-ais wrote: post #252
lebovic wrote: post #202

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

Pretty sure Amodei makes noise about mass unemployment because he is very bothered by the technology that the entire industry (of which Anthropic just one player) is racing to build as fast as possible?

Why do you think he is not bothered at all, when they publish post after post in their newsroom about the economic effects of AI?

Re: Statement from Dario Amodei on our discussions with the Department of War

#448

Post by skeptic_ai »

neom wrote: post #319
lebovic wrote: post #202

I used to work at Anthropic, and I wrote a comment on a thread earlier this week about the RSP update [1]. It's enheartening to see that leaders at Anthropic are willing to risk losing their seat at the table to be guided by values. Something I don't think is well understood on HN is how driven by ideals many folks at Anthropic are, even if the company is pragmatic about achieving their goals. I have strong signal th…

I've had so much abuse thrown at me on here for saying this very thing over the last few years. I used to be friends with Jack back in the day, before this AI stuff even all kicked off, once you know who people really are inside, it's easy to know how they will act when the going gets rough. I'm glad they are doing the right thing, but I'm not at all surprised, nor should anyone be. Personally I believe they would go…

[flagged]

Re: Statement from Dario Amodei on our discussions with the Department of War

#449

Post by elicash »

helaoban wrote: post #72
alangibson wrote: post #4

It's not named the Department of War because Congress didn't rename it. Other than that, good on ya.

It SHOULD be called the Department of War, as it was originally, since it makes its function clear. We are a society that has euphemized everything and so we no longer understand anything.

It's a funny thing that the most war-loving people and the most peace-loving people both love calling it "Department of War" - just for different reasons.

But the reason for "Department of Defense" name was bureaucratic. It's also not true that DOD is hard to understand.

Re: Statement from Dario Amodei on our discussions with the Department of War

#450

Post by skeptic_ai »

victor106 wrote: post #297
bnr-ais wrote: post #252

Earlier quoted context omitted.

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

> Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. What do you suppose he should do if that’s what he thinks is going to happen? And how do you know he’s not bothered by it at all?

He could stop from happening instead of accelerating it? Wishful thinking
Post reply on HN