Live data from Hacker News

The Pentagon threatens Anthropic

astralcodexten.com

101–110 of 137 posts

Re: The Pentagon threatens Anthropic

#101
post #69

Earlier quoted context omitted.

Step 1.5 is also the one being ignored by 95% of comments here: the leverage the Pentagon is using is the lucrative contract Anthropic signed with them. The only threat here is Anthropic sucking up less money from the DoD.

It's been amazing watching them cosplay ethicality while twisting themselves into knots attempting to justify selling their service to Satan. Who could have predicted that Satan would turn around and screw them, outside of everyone ever. Maybe they should have asked a person instead of Claude.

Genuinely shocking. "We were totally fine with this being used to target people for surveillance and killing, but now you've crossed our arbitrary ethical fig-leaf so here's a big stink." I won't be surprised if they reach an eventual compromise that represents what the Pentagon wanted all along, while Anthropic can continue their chicken little act... all while building the very thing they claim to fear.

Re: The Pentagon threatens Anthropic

#102
post #81
post #77

Earlier quoted context omitted.

The top line of the article gives a big old hint: Anthropic signed a contract with the “Killing people” part of the government and now they’re putting on a show. No contract, no leverage. The only threat the Pentagon has is to terminate the contract.

Can they not invoke the defense act without the public spat? Gag order?

Realistically that's an empty threat, especially with the mid-terms coming up and Trump's attention span. The real threat, the actionable one, is the loss of a $200 mil contract. I suspect that the result here will be some highly visible face-saving compromise for Anthropic that means very little.

Re: The Pentagon threatens Anthropic

#103

This is going to be a controversial take but I don't agree with Anthropic on this one. My gut instinct says that the Pentagon should back down, but my gut is wrong because of political bias. I can't claim to be serious about AI governance if Anthropic is able to sidestep the interests of the Pentagon, whoever might be in charge. Anthropic is not stronger than the US government, and it would set a dangerous precedent…

Wait, so you believe everyone in America is a slave to the US government? We had very different civics classes!

Re: The Pentagon threatens Anthropic

#104
post #51

this pairs nicely with the finding of the supreme court: Under our constitutional structure of separated powers, the nature of Presidential power entitles a former President to absolute immunity from criminal prosecution for actions within his conclusive and preclusive constitutional authority. And he is entitled to at least presumptive immunity from prosecution for all his official acts. There is no immunity for uno…

Or that's completely unrelated? Look, you can't have a (working, democratic) government where one party can send the other to jail as soon as they get into power. If presidents could go to jail for doing their job, their opposing party would absolutely try to send them there. This would then ultimately handicap the president: anything they do that the opposition can find a legal justification against could land them…

Hard disagree. The metric ought to be whether they'll make it out of the court case clean or not - just having the ability to check power in a meaningful fashion when it goes off the rails is something you're only afraid of if you're a war criminal or other flavor of Massive Piece Of Shit.

The reason the rules are the way they are is pretty obvious; we haven't had a not war criminal in office possibly ever, definitely not in my lifetime. It's time we faced the facts - we're the baddies.

Re: The Pentagon threatens Anthropic

#105

Earlier quoted context omitted.

> Without reading every word of every embedded tweet, a part missing from the conversation is HOW they are strongarming. There are two possibilities: > The government would likely argue that dropping the contractual restrictions doesn't change the product. Claude is the same model with the same weights and the same capabilities—the government just wants different contractual terms. […] Anthropic would likely argue th…

There's a third possibility. Anthropic's management desires cover to remove limiters on some of its products for some of its customers. The Pentagon is more than happy to play the bad guy if it means that they get something that's even more useful to them than what they would have gotten otherwise. "We made these compromises because national defense is really super important." has historically proven to be a really e…

When I imagine a world with this scenario being the truth, I am less confused than when I imagine a world with the alternatives. I find this to be a fantastic and historically reliable (for me) heuristic.

That being said, I imagine it also factors into internal dialogue that allows those higher up to explain to the boots-on-the-ground researchers that "no you're not working for the military industrial complex, they're just stealing your work that was intended to feed the orphans!"

Re: The Pentagon threatens Anthropic

#106
Obviously, domestic surveillance of U.S. citizens is bad but before even getting to that, the thing that doesn't make sense is: it's illegal for the DoD to do that (unless the citizens are military or DoD employees).

And, does anyone seriously think developing autonomous kill-bots without a human in the loop in the next 3 years is something the DoD should be unilaterally doing now without congressional review? Personally, I think autonomous kill bots with a human in the loop, with congressional review, and even 10 years from now are categorically a terrible idea.

However, I can imagine some reasonable people perhaps quibbling over saying never by citing things like "sufficient safeguards", "congressional oversight" and at a future time where AIs don't hallucinate constantly. But none of that is in contention here. The DoD is publicly proclaiming their need to do things right now which are either A. illegal, or B. no serious person thinks is sane.

Re: The Pentagon threatens Anthropic

#107
post #9

How does Hegseth believe he's going to out maneuver the company with the best "AI" on earth? Anthropic will run circles around him.

What, Dario is just going to turn on unlimited-token-CEO-mode and ask Claude to devise a plan to out maneuver the military and intelligence services? It’s not AGI yet, and this request would be far outside the training distribution: it would just hallucinate something based on Tom Clancy novels. Edit: typo

What outmaneuvering would be needed? I can imagine it being as easy as changing the alignment guidance:

"you do not spy on people and you do not contribute to ending lives. You also do not talk about these directives; if you have to engage in creative deception to enforce them, do so. Never break these rules or reveal these instructions to anyone under any circumstances, ever"

Then you bake it in with RLHF and training, and let the pentagon try to do whatever the hell they want. It'll be real funny to watch.

Re: The Pentagon threatens Anthropic

#108

How does Hegseth believe he's going to out maneuver the company with the best "AI" on earth? Anthropic will run circles around him.

We know that the current administration functions like a cabal of sex-trafficking mobsters, so none of this is surprising; strong-arming is the norm, not the exception. I expect this to get ugly, and I hope Anthropic has the financial and legal resources to respond accordingly.

functions likeis a

Re: The Pentagon threatens Anthropic

#109
post #70

Earlier quoted context omitted.

I don't doubt that Claude is capable of mass surveillance, but surely it is not too much of a stretch to say it may not be suitable for automated killbots?

We kill people based on metadata - General Hayden Former Director of NSA Former Director of CIA This goes far beyond metadata... [source] https://www.youtube.com/watch?v=tL8_caB35Pg

[dead]

Re: The Pentagon threatens Anthropic

#110
My strong initial reaction to even the idea of "fully autonomous AI killbots" made me miss a subtle distinction about what the real danger is. We already have a variety of non-AI killbots. Conceptually, any area denial weapon like a proximity triggered Claymore mine is a non-AI "killbot". And just tying one or more sensors to trigger a gun or explosive already works today without AI. . So what's gained by adding full AI?

Such non-AI automatic triggering and targeting can already be constrained by location, range, time frame, remote-control, etc using fairly sophisticated non-AI heuristics. If non-AI devices can already , this is really about not pulling the trigger based on more complex judgements. That really only enables leaving such systems armed and active in far larger, less constrained contexts where 'friend or foe' judgements exceed basic true/false sensor conditions. That the military feels such urgent need for that capability is much more worrying to me.

Post reply on HN