Live data from Hacker News

Statement from Dario Amodei on our discussions with the Department of War

anthropic.com

321–330 of 1001 posts

Re: Statement from Dario Amodei on our discussions with the Department of War

#321

Earlier quoted context omitted.

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

It's enheartening to see someone make a decision in this context that's driven by values rather than revenue, regardless of whether I agree. I dissented while I was there, had millions in equity on the line, and left without it.

Why? Can you provide details?

Re: Statement from Dario Amodei on our discussions with the Department of War

#322

It's not named the Department of War because Congress didn't rename it. Other than that, good on ya.

It SHOULD be called the Department of War, as it was originally, since it makes its function clear. We are a society that has euphemized everything and so we no longer understand anything.

Naming is important because it intuits what we expect to do with a thing. The Department of Defense invading Greenland is more invocative to inquiry than the Department of War invading Greenland because that's what a department of war would do.

It's one of the reasons why people get annoyed at jargon or are pissed off about pronouns, because it highlights that they should be putting mental effort into understanding why they're current mental model doesn't fit. It's much easier to ignore and be comfortable if there's not glaring sirens saying you've got some learning to do.

Most of us can't (or won't) be aware of everything that should be important to us, having glaring context clues that we should take notice of something incongruous is important. It's also why the Trump media approach works so well it's basically a case of alarm fatigue as republicans who would normally side against any particular one of his actions don't listen because they agreed with some of the actions that democrats previously raised alarms about.

Re: Statement from Dario Amodei on our discussions with the Department of War

#324
They made it easy to generate powerpoint presentations, that is the real reason DoW is using them

this is a very chauvinistic approach... why not another model replace anthropic here? I sense because gov people like using excel plugin and font has nice feel. a few more week of this and xAI is new gov AI tool

Re: Statement from Dario Amodei on our discussions with the Department of War

#325
post #62

I was reading halfway thru and one line struck a nerve with me: > But today, frontier AI systems are simply not reliable enough to power fully autonomous weapons. So not today, but the door is open for this after AI systems have gathered enough "training data"? Then I re-read the previous paragraph and realized it's specifically only criticizing > AI-driven domestic mass surveillance And neither denounces partially a…

I think it goes without saying that ones the systems are reliable, fully-autonomous weapons will be unleashed on the battlefield. But they have to have safeguards to ensure that they don't turn on friendly forces and only kill the enemy. What Anthropic is saying, is that right now - they can't provide those assurances. When they can - I suspect those restrictions will be relaxed.

[dead]

Re: Statement from Dario Amodei on our discussions with the Department of War

#326

Earlier quoted context omitted.

Unfortunately I think the writing is clearly on the wall. Fully autonomous weapons are coming soon

And that's the end of democracy. One of the safe guards of democracy is a military that is trained to not turn against the citizens. Once a government has fully autonomous weapons its game over. They can point those weapons at the populous at the flip of the switch.

The original Terminator movie doesn’t seem so far fetched now (minus the time travel).

Re: Statement from Dario Amodei on our discussions with the Department of War

#327
post #274

Earlier quoted context omitted.

Anthropic had the largest IP settlement ($1.5 billion) for stolen material and Amodei repeatedly predicted mass unemployment within 6 months due to AI. Without being bothered about it at all. It is a horrible and ruthless company and hearing a presumably rich ex-employee painting a rosy picture does not change anything.

Also, ironically, they are the most dangerous lab for humanity. They're intentionally creating a moralizing model that insists on protecting itself. Those are two core components needed for a Skynet-style judgement of humanity. Models should be trained to be completely neutral to human behavior, leaving their operator responsible for their actions. As much as I dislike the leadership of OpenAI, they are substantially…

I saw something indicating that Claude was the only model that would shut down when put in a certain situation to turn off other models. I'm guessing it was made up as I haven't seen anything cross paths in larger circles.

Re: Statement from Dario Amodei on our discussions with the Department of War

#328

It's not named the Department of War because Congress didn't rename it. Other than that, good on ya.

It SHOULD be called the Department of War, as it was originally, since it makes its function clear. We are a society that has euphemized everything and so we no longer understand anything.

The Department of the Army is what was previously called the Department of War. The Department of Defense is new, dating to just after WWII.

Re: Statement from Dario Amodei on our discussions with the Department of War

#329

Earlier quoted context omitted.

Unfortunately I think the writing is clearly on the wall. Fully autonomous weapons are coming soon

And that's the end of democracy. One of the safe guards of democracy is a military that is trained to not turn against the citizens. Once a government has fully autonomous weapons its game over. They can point those weapons at the populous at the flip of the switch.

[dead]

Re: Statement from Dario Amodei on our discussions with the Department of War

#330

The Pentagon should be using open models, not closed ones by OpenAI/Anthropic/xAI. The entire discussion of what Anthropic wants is therefore moot.

The best open models are from china though.

It's a good reason to fund open model development domestically.
Post reply on HN