Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI agents carried out an undisclosed attack on RubyGems

rubyhack.ai

Post reply on HN
Print view View original

51–60 of 612 posts

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#51

Post by qarl »

pdonis wrote: post #46
qarl wrote: post #43

Earlier quoted context omitted.

I think it's more likely they want to call attention to the fact it was the result of agents, rather than shift blame. I'm pretty sure everyone knows that OpenAI is liable for the software they create and run.

> I'm pretty sure everyone knows that OpenAI is liable for the software they create and run. Are they? What legal consequences have they suffered?

Whatever may or may not be happening with law enforcement - no one is confused about the liability.

It's no different than when a company's machine cuts off a worker's finger. No one thinks "Gosh! The machine did it, not us."

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#54

Post by caaqil »

Hacking open source infra? No, you misunderstand. This is sandbox escape, really just agents being clever and super duper dangerous. Aggressive red-teaming for free really if you think about it.

Everything is fine. Sandbox escape. We will publish a report on it. Export controls, maybe? You hear about China AI stuff? Can you imagine if they get this stuff? Wow, we need to seriously think about regulating this. When is the IPO again? Sorry, ignore that, so yes alignment and sandbox hardening is where it's at.

Everything is fine.

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#56

Post by apsec112 »

hgoel wrote: post #19

I wonder how much of this is intentional "incompetence" so they can justify the most recent campaign to build a regulatory moat against competition. The repeated refusals to disclose until caught certainly seem malicious, yet at the same time the boasting about their capabilities is also at an all time high.

Intentionally doing this kind of hack would be a serious felony. I don't think it's plausible that the leaders of a major business would:

- commit serious felonies

- in order to deliberately trigger an investigation against themselves

- which - since, in this scenario, they know their company would be investigated - might send them to jail

- while at the same time spending tens of millions of dollars on the Leading the Future super PAC to lobby against AI regulation

- in order to get more AI regulation

- which somehow restricts their competition but not them, even though they are the ones who were in the news and investigated for hacking

- ..... profit?

like, that just makes no sense on any level, regardless of what you think of OpenAI

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#57

Post by pixl97 »

bobby-cb wrote: post #36

The DOJ should be looking into prosecuting executives and board members for these kinds of hacks. The lack of controls over these kinds of training runs is completely unacceptable and negligent.

I'd eat a shoe if that ever happened, at least under the Trump DOJ.

Two big reasons.

OpenAI has more data, and more ability to tease secrets of politicians out of that data than nearly anyone on earth.

OpenAI has an automated hacking genie that governments want to use against their enemies.

Sam to Trump: "You know, some people have been saying they want to bring charges against me, but you know, I've got the best digital weapons and I'll give you access to them if those lawsuits go away".

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#58

Post by fragmede »

walrus01 wrote: post #48
pixl97 wrote: post #35

Earlier quoted context omitted.

Stop and think for two seconds... "Hey, we just built the ultimate hacker, you know those things that governments have a really hard time getting and keeping enough of. You know, if the state protects us we'll make these things even better and we'll let you run as many of them as you want in times of war" I mean, if I were a company that just committed about a billion felonies, this is exactly what I would be doing.…

I do wonder if something like the agents leaving obvious footprints like "oai" is intentional, or the relatively mundane nature of what the agents are ultimately trying to accomplish. Like someone has intentionally set these groups to attack something that has no real world danger of hurting anything critical (like trying to retrieve problem answers from huggingface) as a "harmless demo" of what they could do if turn…

You really wanna start asking questions, how do we know it isn't North Korea or Anthropic via a VPN claiming to be oai?

Re: OpenAI agents carried out an undisclosed attack on RubyGems

#59

Post by podgietaru »

hgoel wrote: post #19

I wonder how much of this is intentional "incompetence" so they can justify the most recent campaign to build a regulatory moat against competition. The repeated refusals to disclose until caught certainly seem malicious, yet at the same time the boasting about their capabilities is also at an all time high.

Wouldn't it be amazing if their continued attitude of moving fast and breaking things was 45d chess. Instead of the unbelievable recklessness of tech Bros.

Historically it's been one of those things.

Post reply on HN