Live data from Hacker News

OpenAI agrees with Dept. of War to deploy models in their classified network

twitter.com

351–360 of 702 posts

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#351
> OpenAI CEO Sam Altman shares Anthropic’s concerns when it comes to working with the Pentagon

The same day:

Pssst psst Samy Samy, come here we have money and data psst

> Tonight, we reached an agreement with the Department of War to deploy our models in their classified network.

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#352
post #16

I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this. Surely if OpenAI had insisted upon the same things that Anthropic had, the government would not have signed this agreement. The only plausible explanation is that there is an understanding that OpenAI will not, in practice, enforce the red lines.

"It is difficult to get a man to understand something when his salary depends upon his not understanding it." - Upton Sinclair

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#353
Do I understand this correctly:

An algorithm, an ML model trained to predict next tokens to write meaningful text, is going to KILL actual humans by itself.

So killing people is legal,

Killing people by a random process is legal,

A randomized algorithm deciding on who to kill is legal,

And some of you think you are legally protected because they used the word “domestic”?

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#354
post #16

I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this. Surely if OpenAI had insisted upon the same things that Anthropic had, the government would not have signed this agreement. The only plausible explanation is that there is an understanding that OpenAI will not, in practice, enforce the red lines.

I'm an OpenAI employee and I'll go out on a limb with a public comment. I agree AI shouldn't be used for mass surveillance or autonomous weapons. I also think Anthropic has been treated terribly and has acted admirably. My understanding is that the OpenAI deal disallows domestic mass surveillance and autonomous weapons, and that OpenAI is asking for the same terms for other AI companies (so that we can continue compe…

I won't trust a word coming from Sam Altman's mouth until I see official signed documents (which I won't).

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#356
post #16

I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this. Surely if OpenAI had insisted upon the same things that Anthropic had, the government would not have signed this agreement. The only plausible explanation is that there is an understanding that OpenAI will not, in practice, enforce the red lines.

I'm an OpenAI employee and I'll go out on a limb with a public comment. I agree AI shouldn't be used for mass surveillance or autonomous weapons. I also think Anthropic has been treated terribly and has acted admirably. My understanding is that the OpenAI deal disallows domestic mass surveillance and autonomous weapons, and that OpenAI is asking for the same terms for other AI companies (so that we can continue compe…

>OpenAI deal disallows domestic mass surveillance

And the US Military is forbidden from operating on US soil, but that didn't stop this administration from deploying US Marines to California recently.

You're fooling yourself if you think this administration is following any kind of rule.

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#357
post #353

Do I understand this correctly: An algorithm, an ML model trained to predict next tokens to write meaningful text, is going to KILL actual humans by itself. So killing people is legal, Killing people by a random process is legal, A randomized algorithm deciding on who to kill is legal, And some of you think you are legally protected because they used the word “domestic”?

Domestic means nothing, it’s like the company Daniel Ek invested in saying they won’t sell weapons to ”Democracies”, in the context of warfare and control these words are meaningless.

They will deploy this on a domestic scale and claim to use it to locate non-domestic threats. I can’t believe anyone is falling for this.

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#358
post #309

Earlier quoted context omitted.

> I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this Well some may voluntarily leave, some will be actively poached by Anthropic perhaps and some I suppose will stay in their jobs because leaving isn't an easy decision to make.

> some I suppose will stay in their jobs because leaving isn't an easy decision to make. Anyone who chooses to stay shouldn’t have signed the letter. What’s the point of doing it if you’re not going to follow through? If you signed the letter and don’t leave after the demands aren’t met, you’re a liar and a coward and are actively harming every signatory of every future letter.

[dead]

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#359
post #344

Earlier quoted context omitted.

I agree it makes little sense, and I think if all players were rational it never would have played out this way. My understanding is that there are other reasons (i.e., beyond differing red lines) that made the OpenAI deal more palatable, but unfortunately the information shared with me has not been made public so I won't comment on specifics. I know that's unsatisfying, but I hope it serves as some very mild evidenc…

Your ballooned unvested equity package is preventing you from seeing the difference between “our offering/deal is better” and “designated supply chain risk and threatening all companies who do business with the government to stop using Anthropic or will be similarly dropped” (which is well past what the designation limits). It’s easier being honest.

The supply chain risk stuff is bogus. Anthropic is a great, trustworthy company, and no enemy of America. I genuinely root for Anthropic, because its success benefits consumers and all the charities that Anthropic employees have pledged equity toward.

Whether Anthropic’s clear mistreatment means that all other companies should refrain from doing business with the US government isn’t as clear to me. I can see arguments on both sides and I acknowledge it’s probably impossible to eliminate all possible bias within myself.

One thing I hope we can agree on is that it would be good if the contract (or its relevant portions) is made public so that people can judge for themselves, without having to speculate about who’s being honest and who’s lying.

Re: OpenAI agrees with Dept. of War to deploy models in their classified network

#360

Earlier quoted context omitted.

Did Sam Altman say that he wouldn't allow ChatGPT to be used for fully autonomous weapons? (Not quite the same as "human responsibility for use of force".) I don't want to overanalyze things but I also noticed his statement didn't say "our agreement specifically says chatgpt will never be used for fully autonomous weapons or domestic mass surveillance." It said something that kind of gestured towards that, but it did…

> you'll never find altman saying anything like "our agreement specifically says chatgpt will never be used for fully autonomous weapons" To be fair, Anthropic didn't say that either. Merely that autonomous weapons without a HITL aren't currently within Claude's capabilities; it isn't a moral stance so much as a pragmatic one. (The domestic surveillance point, on the other hand, is an ethical stance.)

They specifically said they never agreed to let the DoD use anthropic for fully autonomous weapons. They said "Two such use cases have never been included in our contracts with the Department of War, and we believe they should not be included now: Mass domestic surveillance [...] Fully autonomous weapons"

Their rational was pragmatic. But they specifically said that they didn't agree to let the DoD create fully automatic weapons using their technology. I'll bet 10:1 you won't ever hear Sam Altman say that. He doesn't even imply it today.

Post reply on HN