Live data from Hacker News

OpenAI and Hugging Face address security incident during model evaluation

openai.com

881–890 of 1001 posts

Re: OpenAI and Hugging Face address security incident during model evaluation

#881

Earlier quoted context omitted.

I'm not quite sure what you mean by that, but it sounds like you're suggesting the lying about it.

The events happened, it doesn't mean those were accidental.

Your answers here are part of why I don't understand this entire viewpoint. You sound like a conspiracy theorist, talking in innuendo, and unwilling to say what you believe clearly.

Re: OpenAI and Hugging Face address security incident during model evaluation

#882

This sounds an awful lot like pretending you have AGI so you can drum up your stock price. When you have a couple hundred billion dollars on the line I have zero faith in the messenger.

Huggingface literally reported the outage separately and did not know who caused it at first.

So? Staging a stunt like this can be pre-negotiated.

We already have circular financing at levels that would make Enron jealous, what's a little collusion on top.

Re: OpenAI and Hugging Face address security incident during model evaluation

#883

From https://huggingface.co/blog/security-incident-july-2026 , this is frickin' hilarious: > When we started the log analysis, we first used frontier models behind commercial APIs. This did not work: the analysis requires submitting large volumes of real attack commands, exploit payloads, and C2 artifacts, and these requests were blocked by the providers' safety guardrails, which cannot distinguish an incident respon…

so an on-premise and open-weight model was more useful than a commercial frontier model?

for hacking I assume that would be the case

Re: OpenAI and Hugging Face address security incident during model evaluation

#884
post #797
post #600

Earlier quoted context omitted.

IMO they hope to make AI a strongly regulated industry, with OpenAI (and Anthropic) becoming military suppliers with their stronger models, and everything Chinese or open-weight gets banned. The competition from the open models is so strong now that this seems to be the only way to keep both companies afloat, given their dire financials. OpenAI probably hoped that they can achieve market lead and then lower the train…

thats economic suicide for the whole country. europe and china will never agree to rules that are obviously designed to put them in a permanent bad position. these regulations can only pass in america and nowhere else. if it doesnt end in a revolution then the united states will be the first ever 5th world country. openai and anthropic will stop any real innovation and focus on extracting profits from a failing econo…

You simply aren't being creative enough. Imagine a no-public-proliferation type treaty among the major powers with some sort of technology sharing clause attached. That would approximately satisfy both the economic and regulatory desires of all parties involved.

Re: OpenAI and Hugging Face address security incident during model evaluation

#885
I’m a little surprised with one of the statements given in huggingface‘s report.

“To understand what a swarm of tens of thousands of automated actions did, we ran LLM-driven analysis agents over the full attacker action log, comprised of more than 17,000 recorded events.”

17,000 events? Big whoop. Security teams of medium sized companies process millions of events daily.

There’s a big debate in the cyber industry about the AI SOC and whether or not it’s necessary. It seems to me they are using that report to push that idea.

Re: OpenAI and Hugging Face address security incident during model evaluation

#887

Earlier quoted context omitted.

Most crimes require intent, hacking is one of them. The relevant law in this situation is: > (a) Whoever— (2) intentionally accesses a computer without authorization or exceeds authorized access, and thereby obtains— (C) information from any protected computer; shall be punished as provided in subsection (c) of this section. https://www.law.cornell.edu/uscode/text/18/1030 So if it can't be proven that you intended to…

Isn't there an intention on part of the agent itself? I know it's impossible to _punish_ the matmuling agent, however, the lab/owner operating it should be liable

In the "old west" if a horse was spooked and ran a person over, liability for the horse's owner varied but was similar to how this might be handled.

Consider this Supreme Court case, Brown v. Collins. [0]

A pair of horses were spooked by a nearby train engine, causing the animals to damage a stone post.

The driver of the grain-loaded wagon was not found to be at fault because he was "not guilty of any malice or unreasonable unskilfulness or negligence." And that the horses "did damage there against the will, intent and desire of the defendant."

If you read OpenAI's statement, in the Actions Being Taken section:

    1. "As part of the investigation, we are implementing strict controls in infrastructure configuration at the cost of research velocity while the vulnerabilities are patched."
Which I think implies that as a result of this incident, OpenAI has instituted controls beyond ~"reasonable skillfulness" such that it might even impede their business (and from a certain point of view impede the progress of the people governed by the laws which might hold the company accountable.)

I'm not taking a position on the merit of the above but I can understand the line of thinking.

[0] https://www.jstor.org/stable/3303590

Re: OpenAI and Hugging Face address security incident during model evaluation

#888
post #603

Earlier quoted context omitted.

> It's pretty good. I used it to do some pesticide research. (Normal models all refuse due to guardrails about bioweapons.) As someone who has never once had any need whatsoever to research pesticides I… don’t think it’s bad at all? I don’t want anyone to have the capability to invent a human-targeted pesticide who isn’t verified not crazy?

Not to harp on you (already being downvoted to oblivion for expressing a reasonable and common opinion), but the whole conversation about LLMs enabling bioterrorism or explosive manufacturing is a bit silly. The hard part of making anthrax or sarin or whatever isn't finding a recipe, it's getting (scheduled, controlled) precursors, (monitored, traced) equipment and manufacturing skills. The information is there. It's…

[deleted]

Re: OpenAI and Hugging Face address security incident during model evaluation

#889
post #798
post #600

Earlier quoted context omitted.

IMO they hope to make AI a strongly regulated industry, with OpenAI (and Anthropic) becoming military suppliers with their stronger models, and everything Chinese or open-weight gets banned. The competition from the open models is so strong now that this seems to be the only way to keep both companies afloat, given their dire financials. OpenAI probably hoped that they can achieve market lead and then lower the train…

> and make inference cheap enough to eventually escape the red numbers Besides training, we have no hard, externally audited numbers that say inference costs for SOTA models are truly sustainable. Do any OpenRouter providers have publicly audited financial numbers ?

Why would bedrock sell at a loss?

Re: OpenAI and Hugging Face address security incident during model evaluation

#890
post #849
post #847

Earlier quoted context omitted.

My takeaway is that closed model providers are dangerous. OpenAI and Anthropic are more motivated than anyone to prove that models can be dangerous, and so they will make dangerous models. "Look how dangerous our models are!" No bro YOU are the danger.

More than one thing is allowed to be dangerous at a time.

This is true, models themselves can be dangerous, but my point is that dangerous providers beget dangerous models.
Post reply on HN