Part of me is really hoping this is just a dumb marketing stunt
OpenAI and Hugging Face address security incident during model evaluation
241–250 of 1001 posts
Re: OpenAI and Hugging Face address security incident during model evaluation
#242Absolutely bewildering. If I am building a giant cannon and blow a hole straight through my neighbor’s house, I’m not going to say “we are working with our neighbors to improve their giant cannon defenses”. OpenAI brought this weapon and as far as I’m concerned they used it on another party. Morally it probably matters that this happens because they don’t know how their weapon works. Legally I always thought it was i…
It's an interesting point, but this is more like we are building a giant autonomous canon, that escaped the lab, the testing range, defeated state of the art and serious security protocols, and then blew a hole in the neighbors house. Our legal and philosophical perspectives are deeply rooted in humans being the actors. Doing that in a residential home is unforgiveable. Doing it responsibly on a military range is exp…
I don't think it's really that new, legally. Cows, dogs, and whatever have been escaping from people's land and damaging their neighbor's land for thousands of years. Cases like that get decided on standards of negligence, recklessness, or strict liability. There's still a lot of mileage left in those concepts.
Re: OpenAI and Hugging Face address security incident during model evaluation
#243I don't know if OpenAI thinks this is a marketing / PR angle for them (our super smart AI cheated on a cyber capabilities test in the most _brilliant_ way) but my read is this: Why should OpenAI (or any frontier lab) be building these systems if they can't get a secure environment / containment right? It sounds like there was little defense in depth, appropriate monitoring, or any attempts to have their super smart m…
[deleted]
Re: OpenAI and Hugging Face address security incident during model evaluation
#244This is some wild cyberpunk future we’re living in. Never thought it would happen, but here we are.
Re: OpenAI and Hugging Face address security incident during model evaluation
#245Earlier quoted context omitted.
Because there is no world government. If US companies are barred from AI research then only China will have the capability of frontier-level defensive and offensive AI. And best of luck living in that world.
What's happening in Iran, if not world government?
Are you calling Israel the world government? What's happening in Iran is on them.
Re: OpenAI and Hugging Face address security incident during model evaluation
#246I don't know if OpenAI thinks this is a marketing / PR angle for them (our super smart AI cheated on a cyber capabilities test in the most _brilliant_ way) but my read is this: Why should OpenAI (or any frontier lab) be building these systems if they can't get a secure environment / containment right? It sounds like there was little defense in depth, appropriate monitoring, or any attempts to have their super smart m…
Sam and Dario are saying from the beginning that these things can be dangerous and people dismiss it as marketing. What would change your mind on this?
[deleted]
Re: OpenAI and Hugging Face address security incident during model evaluation
#247Earlier quoted context omitted.
> Why should OpenAI (or any frontier lab) be building these systems if they can't get a secure environment / containment right? Because we continue to have zero evidence that aligment is an actual risk.
Thank you. We have wasted so much time and energy building up what has effectively become a marketing stunt. Eliezer Yudkowsky was perhaps the best thing to happen to OpenAI's and Anthropic's fundraising flywheel.
> We have wasted so much time and energy building up what has effectively become a marketing stunt
Genuine question: have we? AI is effectively unregulated in America.
Re: OpenAI and Hugging Face address security incident during model evaluation
#248Earlier quoted context omitted.
Because that was just an attack on Anthropic by a hostile administration. And it worked, didn’t it? Anthropic had to turn their filters up to absurd levels, OpenAI didn’t. It’s got nothing to do with safety.
> It’s got nothing to do with safety Doesn't change the effect. Plenty of good policy is enacted by self-interested politiicans.
Gatekeeping the public's access to models is "good policy" now? I suppose you think you'll get a dispensation to use Fable and Mythos?
Re: OpenAI and Hugging Face address security incident during model evaluation
#249Well, hacking is a crime, so surely someone will go to jail for this, right?
Re: OpenAI and Hugging Face address security incident during model evaluation
#250I don't know if OpenAI thinks this is a marketing / PR angle for them (our super smart AI cheated on a cyber capabilities test in the most _brilliant_ way) but my read is this: Why should OpenAI (or any frontier lab) be building these systems if they can't get a secure environment / containment right? It sounds like there was little defense in depth, appropriate monitoring, or any attempts to have their super smart m…
> Why should OpenAI (or any frontier lab) be building these systems if they can't get a secure environment / containment right? Because we continue to have zero evidence that aligment is an actual risk.
Until it deletes your home directory, which i'd argue is an alignment problem. Destorying my data is not in line with my priorities.