I think I'm the only one thinking that it's pure marketing.
OpenAI’s accidental attack against Hugging Face is science fiction that happened
391–400 of 475 posts
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#392I think I'm the only one thinking that it's pure marketing.
You think you are? Despite that being the point of the HN comment turned into article?
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#393Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#394I'm not skeptical that this attack happened, I'm skeptical that the model's prompt was truly just "solve this benchmark" and nothing more. I'm also trying to figure out why OpenAI put out a press release about this. In what way is this not admitting to a federal crime?
yup I am dead certain that they realized the whole 'our AI is too dangerous' punchline is too played out and they needed something that makes actual splash. Also this incident would serve as a foundation to ban open-weight models because 'with great power comes great responsibility' or some other BS like that. because after all, unwashed masses cannot be expected to be 'responsible' with top of the line intelligence.
I expect these type of hacks to continue till they IPO. after that real public company liability will start taking over.
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#395Hardly science fiction. I respect a lot of Simon's work, but his credibility gets chiseled away a bit each time he participates in these kinds of echo chamber posts that are basically secondhand marketing.
I'm just sad that this whole thing is destroying tech's reputation. Every time I see an engineer give into this marketing nonsense it makes me fear for the future of our field.
I get that people are worried about becoming irrelevant in the era of AI, but resorting to dishonesty to stay afloat just a little longer has a detrimental effect on the entire industry. Worst part, is it's not even convincing marketing nonsense, it's "science fiction".
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#396> Along the way it helped make the strongest case yet for how the imbalance of model availability is hurting our ability to secure our software.
It's crazy to me that this is the kind of conclusion that is drawn. I would say it makes a strong case for how regulation of AI is woefully inadequate. When North Korea launches a nuclear test, we do not say that that illustrates how the imbalance of nuclear technology availability is hurting our ability to ensure global peace and safety.
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#397Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#398The thing with me and this is that the teams that were competing in the DARPA Grand Cyber Competition all had this capability, like, last year. All the attention has been on software security, of extracting the next marginal vulnerability out of heavily-scrutinized large codebases. In the actual professional field of infosec, that's a speciality; another specialty is network pentests and red-teaming, which exploits m…
An upside is that it means really really good scanning will probably be cheaply commodified if it hasn't been already by one of the new AI pentest startups.
The real victims will be pen testers, who work a job whose economics was already really tough.
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#399Earlier quoted context omitted.
That's the fun part. They do know how to airgap things. The models are outsmarting already pretty smart people!
I am the author of AirgapOS and I have designed systems to run in underground zero emissions chambers that are interacted with via carefully verified sd cards and/or fiber optic serial terminals. If OpenAI had done this, the attack would not have happened. In high risk computation 0days must be in your threat model from the start, so you secure things with the laws of physics.
> If OpenAI had done this, the attack would not have happened
But then how would they market their product?
Re: OpenAI’s accidental attack against Hugging Face is science fiction that happened
#400[dead]