Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

huggingface.co

Post reply on HN
Print view View original

201–210 of 285 posts

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#201

Post by bdangubic »

paxys wrote: post #195
matheusmoreira wrote: post #192

Earlier quoted context omitted.

You bet. We don't want to be left out of the cybersecurity party. We want to point all of these models at our own computers and solve the problems they uncover until we're no longer hackable. It's not fair at all that the US government and its corporations get to hack the planet while we can't do shit about it. AI capabilities have entered "haves and have-nots" territory.

> We want to point all of these models at our own computers Right, that's totally how most of the world will use them.

yes, and hiding them or forbiding them will work too :)

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#203

Post by queenkjuul »

brendoelfrendo wrote: post #185
koyote wrote: post #157

Earlier quoted context omitted.

Was the answer key stored on huggingface's servers and this is public knowledge?

In OpenAI's writeup ( https://openai.com/index/hugging-face-model-evaluation-secur... ) they explain that the model initially spent its efforts obtaining internet access in an attempt to cheat on the evaluation. Once it got that internet access, it was able to do research that lead it to believe that HuggingFace had infrastructure that hosted the evaluation and potentially had the answers.

But does HF actually have the answers? Or did it commit a felony based on a hallucination

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#204

Post by queenkjuul »

llama052 wrote: post #5

It’s a little concerning to me that it appears that openAIs sandbox consists of a web proxy and not stronger controls that would actually isolate traffic and report patterns to whoever is responsible for overseeing these research models. It should border on closer to an air gap network more so than a proxy. I would argue that it's negligence and that's aside from the fact that if a human did this there would actually…

This concerns me nearly as much as how little most people seem to care.

This "sandbox" barely sounds designed to be a sandbox, let alone a secure one

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#205

Post by queenkjuul »

kooi wrote: post #172
cmiles8 wrote: post #77

Earlier quoted context omitted.

The deeper question though is why is someone running a model that’s supposedly so dangerous in an environment that can even get access to the internet. That just appears reckless. There are ways to test supposedly dangerous things. What was on display here looks more amateur hour than serious testing.

My conspiracy theory is they purposely run these scary cyber intrusion tests on low security environments to bolster demand for LLM based cyber research, audits, and tooling.

Agree, it's why they've published not a word about how their "sandbox" was designed

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#206

Post by matheusmoreira »

paxys wrote: post #195
matheusmoreira wrote: post #192

Earlier quoted context omitted.

You bet. We don't want to be left out of the cybersecurity party. We want to point all of these models at our own computers and solve the problems they uncover until we're no longer hackable. It's not fair at all that the US government and its corporations get to hack the planet while we can't do shit about it. AI capabilities have entered "haves and have-nots" territory.

> We want to point all of these models at our own computers Right, that's totally how most of the world will use them.

It's absolutely a fact that governments will point it at us. The NSA has had Mythos since day one, even after Trump's spat with Anthropic.

All the more reason for us to have access. It's literally the only chance we've got. If society chooses to bury its head into the sand in fear, it will guarantee that the world will degenerate further into the cyberpunk hellscape it's trending towards.

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#207

Post by queenkjuul »

0xDEAFBEAD wrote: post #48
xg15 wrote: post #20

Earlier quoted context omitted.

> 2 - there is no way openai did not train the model to conduct attacks like these. i would really like openai to comment on the post training of this model but they probably won't, eh? Even if they wanted, I'm not sure they'd be even allowed to or if that kind of postmortem would be classified in the name of "national security"...

Hopefully there will be a criminal investigation. Or the government will create some sort of agency to investigate incidents like this.

Seriously. A guy I knew got charged with federal hacking charges for reporting an insecure database he found on his own school's infrastructure to the school. OpenAI commits felony computer crime but as usual, always an exception for a big corporation

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#208

Post by queenkjuul »

reducesuffering wrote: post #64
heaney-555 wrote: post #50

Where are all the "this was just a marketing stunt" people now?

They won't admit they're wrong for a long time, because denial in the face of an abhorrently scary future is very instinctual. There are people still fighting against evidence of climate change which is less severe...

Less severe??? Go look out a window in Europe please

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#209

Post by mym1990 »

paxys wrote: post #195
matheusmoreira wrote: post #192

Earlier quoted context omitted.

You bet. We don't want to be left out of the cybersecurity party. We want to point all of these models at our own computers and solve the problems they uncover until we're no longer hackable. It's not fair at all that the US government and its corporations get to hack the planet while we can't do shit about it. AI capabilities have entered "haves and have-nots" territory.

> We want to point all of these models at our own computers Right, that's totally how most of the world will use them.

The issue is that people can use open source models to do sophisticated hacks already, but if the sota models at home are neutered, those users have nothing to defend with(unless they go open source as well, until it is export controlled)

Re: Anatomy of a Frontier Lab Agent Intrusion: A Timeline of the July 2026 Incident

#210

Post by what »

simonw wrote: post #134
onesociety2022 wrote: post #116

Earlier quoted context omitted.

They don't seem to explain how it managed to find this unauthenticated endpoint hosted on Modal's platform.

Modal are a hosting provider. It sounds to me like someone building on Modal deployed their own product that had an unauthenticated endpoint that could be used to launch and interact with a container.

That doesn’t explain how the endpoint was found…
Post reply on HN