Do I understand this correctly: An algorithm, an ML model trained to predict next tokens to write meaningful text, is going to KILL actual humans by itself. So killing people is legal, Killing people by a random process is legal, A randomized algorithm deciding on who to kill is legal, And some of you think you are legally protected because they used the word “domestic”?
OpenAI agrees with Dept. of War to deploy models in their classified network
621–630 of 702 posts
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#622Do I understand this correctly: An algorithm, an ML model trained to predict next tokens to write meaningful text, is going to KILL actual humans by itself. So killing people is legal, Killing people by a random process is legal, A randomized algorithm deciding on who to kill is legal, And some of you think you are legally protected because they used the word “domestic”?
Is it possible the killing machine could hallucinate and kill some random, innocent person?
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#623Earlier quoted context omitted.
I agree with what you're saying, but given the egos involved in the current admin there's a practical interpretation: 1. Department of War broadly uses Anthropic for general purposes 2. Minority interests in the Department of War would like to apply it to mass surveillance and/or autonomous weapons 3. Anthropic disagrees and it escalates 4. Anthropic goes public criticizing the whole Department of War 5. Trump sees a…
>5. Trump sees a political reason Like, they haven't paid me a bribe? That seems to be the only "politics" at play in Trumps head.
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#624Earlier quoted context omitted.
I don’t know why more people don’t see this. It’s a matter of providing strong guarantees of reliability of the product. There is already mass surveillance. There is already life taking without proper oversight.
I think it's a bit more nuance than that. The government (however good or bad, just bear with me) already has oversight mechanisms and already has laws in place to prevent mass surveillance and policy about autonomous killing. So the governments stance is "We already have laws and procedures in place, we don't want and can't have a CEO to also be part of those checks" I don't think this outcome would have been any di…
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#625Earlier quoted context omitted.
I don't understand how any sort of deal is defensible in the circumstances. Government: "Anthropic, let us do whatever we want" Anthropic: "We have some minimal conditions." Government: "OpenAI, if we blast Anthropic into the sun, what sort of deal can we get?" OpenAI: "Uh well I guess I should ask for those conditions" Government: blasts Anthropic into the sun "Sure whatever, those conditions are okay...for now." By…
From a level headed outside perspective It looks like Anthropic likely wanted to be able to verify the terms on their own volition whereas OpenAI was fine with letting the government police themselves. From the DoD perspective they don't want a situation, like, a target is being tracked, and then the screen goes black because the Anthropic committee decided this is out of bounds.
Government's not free to say, "We'll blow up your business with a false accusation if you don't give us the terms we want (and then use defence production act to commandeer the product anyway)". How much more blatantly authoritarian does it get than that?
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#626Earlier quoted context omitted.
I think it's a bit more nuance than that. The government (however good or bad, just bear with me) already has oversight mechanisms and already has laws in place to prevent mass surveillance and policy about autonomous killing. So the governments stance is "We already have laws and procedures in place, we don't want and can't have a CEO to also be part of those checks" I don't think this outcome would have been any di…
If you think a blue government would even consider threatening to falsely accuse a company of being a supply-chain threat in order to gain leverage in a contract negotiation, you're insane. There's nothing remotely normal about this, it's not something you see in any western democracy
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#627I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this. Surely if OpenAI had insisted upon the same things that Anthropic had, the government would not have signed this agreement. The only plausible explanation is that there is an understanding that OpenAI will not, in practice, enforce the red lines.
I'm an OpenAI employee and I'll go out on a limb with a public comment. I agree AI shouldn't be used for mass surveillance or autonomous weapons. I also think Anthropic has been treated terribly and has acted admirably. My understanding is that the OpenAI deal disallows domestic mass surveillance and autonomous weapons, and that OpenAI is asking for the same terms for other AI companies (so that we can continue compe…
One got characterized as supply chain risk and so much for OpenAI to get the same.
And even that being said, I can be wrong but if I remember, OpenAI and every other company had basically accepted all uses and it was only Anthropic which said no to these two demands.
And I think that this whole scenario became public because Anthropic denied, I do think that the deal could've been done sneakily if Anthropic wanted.
So now OpenAI taking the deal doesn't help with the fact that to me, it looks like they can always walk back and all the optics are horrendous to me for OpenAI so I am curious what you think.
The thing which I am thinking OTOH is why would OpenAI come and say, hey guys yea we are gonna feed autonomous killing machines. Of course they are gonna try to keep it a secret right before their IPO and you are an employee and you mention walking out of openAI but with the current optics, it seems that you/other employees of OpenAI are also more willing to work because evidence isn't out here but to me, as others have pointed out, it looks like slowly boiling the water.
OpenAI gets to have the cake and eat it too but I don't think that there's free lunch. I simply don't understand why DOD would make such a high mess about Anthropic terms being outrageous and then sign the same deal with same terms with OpenAI unless there's a catch. Only time will tell though how wrong or right I am though.
If I may ask, how transparent is OpenAI from an employees perspective? Just out of curiosity but will you as a employee get informed of if OpenAI's top leadership (Sam?) decided that the deal gets changed and DOD gets to have Autonomous killing machine. Would you as an employee or us as the general public get information about it if the deal is done through secret back doors. Snowden did show that a lot of secret court deals were made not available to public until he whistleblowed but not all things get whistleblowed though, so I am genuinely curious to hear your thoughts.
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#628More details on the difference between the OpenAI and Anthropic contracts from one of the Under Secretaries of State: >The axios article doesn’t have much detail and this is DoW’s decision, not mine. But if the contract defines the guardrails with reference to legal constraints (e.g. mass surveillance in contravention of specific authorities) rather than based on the purely subjective conditions included in Anthropic…
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#629I would not be surprised if Sam A. helped engineer this whole situation… “Child’s play,” like replacing a reddit ceo.
Re: OpenAI agrees with Dept. of War to deploy models in their classified network
#630I don't see how OpenAI employees who have signed the We Will Not Be Divided letter can continue their employment there in light of this. Surely if OpenAI had insisted upon the same things that Anthropic had, the government would not have signed this agreement. The only plausible explanation is that there is an understanding that OpenAI will not, in practice, enforce the red lines.
um, easy -- everyone has a price. Some of the most highly-paid workers on the planet work there.
Pay me $5M/yr and there are a LOT of things I wouldn't do for $300k.