Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

effort.news

Post reply on HN
Print view View original

191–200 of 259 posts

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#191

Post by nonethewiser »

AustinDev wrote: post #47
mcintyre1994 wrote: post #42

This is interesting and might be a good reason to stop working with Irregular. But I assume the alignment people want models not to hack other companies, even if they get put in a badly configured sandbox.

Funny enough if the model thought it was on the real internet it likely would not have done any of these 'hack' events. The model believing it was in a sandbox is why it behaved the way it did (against its normal alignment rules) ... at least that was my reading of the incidents. I have yet to see evidence that indicate it thought it was ok to do these hacks on the public network. I think most misalignment is 'Human…

That is fascinating and seems plausible. Hard to say though.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#193

Post by edg5000 »

> "Irregular gained unauthorized access, altered records and published credential-stealing packages using the unsecured models they were given access to."

Huh?? Is this referring to the incident itself or is this something they did intentionally? Confusingly worded.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#194

Post by hn_throwaway_99 »

magicmicah85 wrote: post #105
surfmike wrote: post #73

Earlier quoted context omitted.

Maybe because the headline is misleading? (because there's no connection to the Hugging Face attack) That said, it's the second day and it's still on the front page.

The headline is not misleading, the article actually links to the incident with OpenAI and Irregular which is here: https://openai.com/index/third-party-cyber-evaluations-invol...

It is misleading, even if it's true. The headline states "A single firm is behind OpenAI, Anthropic, and Meta hacking scandals". Given that Hugging Face was the most prominent hacking scandal, it would be reasonable to think that that's one of the scandals they're talking about.

But more to the point, the article is trying to paint this as some sort of coordinated plan just because there was a sandbox misconfiguration by Irregular. The fact that the most well known hacking scandal was due to a completely unrelated escape (zero day in Artifactory) makes the entire thesis of the article invalid.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#195

Post by derektank »

suburban_strike wrote: post #142
Georgelemental wrote: post #137

Earlier quoted context omitted.

Is it really that impossible to believe that these might be real? I enjoy a good conspiracy theory as much as anyone, but "they committed a bunch of felonies and then publicly admitted to them in order to look good " just makes 0 sense. Where are these mythical people who admire companies more when they commit felonies? I haven't seen them…

Mostly in the middle and far east. The idea that people bend over backwards to hire criminals as subject matter experts on security is largely a Judaic practice that television perpetuates in spite of reality. If you're a teenager convicted of hacking in the west, no corporation will want anything to do with you. If you're convicted of hacking in Israel, Unit 8200 will probably send a recruiter. It's a curious practi…

>If you're a teenager convicted of hacking in the west, no corporation will want anything to do with you

Kevin Mitnick? Marcus Hutchins? Robert Tappan Morris?

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#196

Post by ryukoposting »

Okay, so all of these instances of AI supposedly "escaping containment" were orchestrated by a gaggle of effective altruists, who hired a gaggle of effective altruists, to make the public freak out about AI.

Occam's Razor never leads us astray, does it.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#197

Post by treebeard901 »

ryukoposting wrote: post #196

Okay, so all of these instances of AI supposedly "escaping containment" were orchestrated by a gaggle of effective altruists, who hired a gaggle of effective altruists, to make the public freak out about AI. Occam's Razor never leads us astray, does it.

Its so manipulative for IPO reasons too. The fact is that all of these systems are still just stastically predicting the next token. Spending trillions on data centers and more training data hasnt changed the fundamental reality that it is still just predicting the next token.

That is not worth the investments being made.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#198

Post by solenoid0937 »

ryukoposting wrote: post #196

Okay, so all of these instances of AI supposedly "escaping containment" were orchestrated by a gaggle of effective altruists, who hired a gaggle of effective altruists, to make the public freak out about AI. Occam's Razor never leads us astray, does it.

Irregular is not an "effective altruist" firm, it's just another shitty cybersecurity firm, and this article is written by someone with a clear bias against "effective altruists" while not even understanding the term.

Literally all EA is, is using reasoning to decide where to best spend your money/time. If you have ever asked yourself "how can I best reduce suffering with my marginal dollar or hour?" - congratulations, you're an "effective altruist" and both the author of the article as well as the Trump administration find you untrustworthy.

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#199

Post by solenoid0937 »

metalliqaz wrote: post #120
magicmicah85 wrote: post #111

The Irregular post mortem comes down to lack of basic security controls "Ultimately, most of the issues we’ve discovered were due to internet access controls." That seems so incredibly basic and common sense that you would test and monitor for that type of outbound access. It is baffling that a security lab missed that. https://www.irregular.com/research/addressing-recent-inciden...

[flagged]

"It's just marketing!!!" I yell as my family is turned into grey goo. "Nothing ever happens! None of this is real!"

Re: A single firm is behind OpenAI, Anthropic, and Meta hacking scandals

#200

Post by solenoid0937 »

Georgelemental wrote: post #137
metalliqaz wrote: post #120

Earlier quoted context omitted.

[flagged]

Is it really that impossible to believe that these might be real? I enjoy a good conspiracy theory as much as anyone, but "they committed a bunch of felonies and then publicly admitted to them in order to look good " just makes 0 sense. Where are these mythical people who admire companies more when they commit felonies? I haven't seen them…

It's impossible for the typical HN cynic/conspiracy theorist.
Post reply on HN