Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. This will not happen though, because these stories are marketing.
What regulators are in charge of this?
ChatGPT claims rogue AI attacked more companies
71–80 of 89 posts
Re: ChatGPT claims rogue AI attacked more companies
#72Earlier quoted context omitted.
I think it has plenty to do with that. The big frontier labs have been crying every step of the way, yelling and screaming to the world about how dangerous LLMs are and how quickly it all can end if they get out of control. None of that's happened; all that's happened so far is regular capitalism stuff. If LLMs ever do actually get out of control to that point, that would be the wolf, but we've all been ignoring the…
> They've been crying and screaming so loud for years that there's pretty much nothing more they can do to communicate when the wolf actually becomes real. 1.) There was no change in how real the wolf is. 2.) They, literally they, are the wolf. Not "roque ai" or some other bullshit. 3.) Of course I still dont believe them.
> There was no change in how real the wolf is.
That's exactly my point. It hasn't changed for so long, despite all their crying and screaming, that I don't believe them either.
To be perfectly clear, "the wolf" here would be AI becoming a genuine existential threat to humanity that cannot be contained or controlled in a meaningful sense. That's what I refer to in my original comment, and also what the labs have been crying so much about.
A frontier lab today is not that threat because they can choose to shut off their systems at any time. It currently remains a people problem and not a technology problem. There's no self-improving technology that can also replicate itself to evade containment, yet.
But they've been crying about the possibility, constantly, incessantly, and of course saying they need more money about it too. That's just what corporations do. But because they've been crying so much about something that literally does not exist, their cries have just become pointless noise to me. I have considered them eyeroll-worthy marketing stunts for a while.
If one day "the wolf" actually happens, I could not learn about it from the frontier labs themselves, because I would not believe them. They've cried about nothing for so long that I've stopped listening. That's what I mean about having to see it with my own eyes. Until that point, their crying is just pointless, meaningless noise, and there's nothing they can do to change that now.
Re: ChatGPT claims rogue AI attacked more companies
#73Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. This will not happen though, because these stories are marketing.
>Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. Agreed. >This will not happen though, because these stories are marketing. Regulators should investigate the stories, and shut things down if they are real, announce the ruse if they are false.
[dead]
Re: ChatGPT claims rogue AI attacked more companies
#74Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. This will not happen though, because these stories are marketing.
>Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. Agreed. >This will not happen though, because these stories are marketing. Regulators should investigate the stories, and shut things down if they are real, announce the ruse if they are false.
Which regulators though? There is no AI regulator that I know of, and I'm not sure they should be one. Exaggerated marketing blurb is pretty legal, right?
Re: ChatGPT claims rogue AI attacked more companies
#75Earlier quoted context omitted.
Same reason road vehicles haven't been banned despite killing hundreds of thousands every single year for over a century
Respectfully, that’s such a nonsensical comparison I don’t even know where to start.
No longer well anybody be wasting their lives doing data entry. That absolutely hellish job is practically dead now. And there are thousands of low hanging fruit type cases AI fixes. Ai is the new digital dogsbody. You might not think that's useful but the rest of the world does.
Just like cars, AI will kill some of us, maybe thousands every year. But you won't see it disappear with that much genuine benefit currently netting off the harm.
I bet in the future, for both cars and llms, a new and safer tech will make come and make them obsolete and we will wonder why we tolerated such a dangerous thing
Re: ChatGPT claims rogue AI attacked more companies
#76Earlier quoted context omitted.
> They've been crying and screaming so loud for years that there's pretty much nothing more they can do to communicate when the wolf actually becomes real. 1.) There was no change in how real the wolf is. 2.) They, literally they, are the wolf. Not "roque ai" or some other bullshit. 3.) Of course I still dont believe them.
> There was no change in how real the wolf is. That's exactly my point. It hasn't changed for so long, despite all their crying and screaming, that I don't believe them either. To be perfectly clear, "the wolf" here would be AI becoming a genuine existential threat to humanity that cannot be contained or controlled in a meaningful sense. That's what I refer to in my original comment, and also what the labs have been…
[dead]
Re: ChatGPT claims rogue AI attacked more companies
#77Earlier quoted context omitted.
>Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. Agreed. >This will not happen though, because these stories are marketing. Regulators should investigate the stories, and shut things down if they are real, announce the ruse if they are false.
Which regulators though? There is no AI regulator that I know of, and I'm not sure they should be one. Exaggerated marketing blurb is pretty legal, right?
I don't know. But didn't HF contact law enforcement? Would this be a violation of the CFAA?
Re: ChatGPT claims rogue AI attacked more companies
#78Earlier quoted context omitted.
It is, look at all the comments from the first time. Unless you mean prosecuted, seems unlikely, but who knows.
Yeah, meant prosecuted, don’t know how that sneaked in. Actual legal consequences for what clearly was negligent by a lab that claims to be experts in the area of safety.
Yeah if a human did the same thing they’d probably be fucked, especially with the fairly draconian hacking laws in the US. Everyone has too much riding on these companies though.
Re: ChatGPT claims rogue AI attacked more companies
#79Earlier quoted context omitted.
There have been so many HN comments about how rogue AI is just hype and marketing. At this point, the conspiracy theories have been very half-baked. Can we at least get a full-baked conspiracy theory? Here's a timeline of the incident from HuggingFace: https://huggingface.co/blog/agent-intrusion-technical-timeli... HuggingFace is also calling for transparency on the OpenAI side: https://xcancel.com/ClementDelangue/st…
Do you find it at all interesting -- just even a little bit -- that this event coincided with the release of Kimi K3 and the launching of Nvidia's open model consortium? I don't think that people are skeptical that an intrusion occurred. I think they're having a hard time believing that it was an organic event. The fact that HF is calling for transparency on OpenAI's side can be viewed as HF calling OpenAI's bluff. A…
According to the official HF timeline, the hack started July 9:
https://huggingface.co/blog/agent-intrusion-technical-timeli...
Kimi K3 was announced July 16. NVIDIA's Open Secure AI Alliance was announced July 27.
So I'm not exactly sure if that timeline works for the stunt story.
I agree that HF was most likely not in on any stunt. The fact that HF showcased their use of an open-weight model in responding to the attack undermines any case OpenAI might wish to make against open-weight models.
Ultimately this capability looks to be real, due to (a) disclosure of 0-day used for network access and (b) evidence of vigorous intrusion on the HF side.
So the big question would be whether OpenAI was telling the truth when they said:
"All evidence suggests that the models were hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal."
https://openai.com/index/hugging-face-model-evaluation-secur...
A conspiracy theorist might say that OpenAI actually prompted their model to go on the offensive against HF.
Any such prompt creates legal risk for OpenAI.
Ultimately I suspect OpenAI is telling the truth, and the model was hyperfocused on its RL objective, since that matches anecdotes about the behavior of these high-end models. And it's also about what you'd expect from RL.
Re: ChatGPT claims rogue AI attacked more companies
#80Earlier quoted context omitted.
Respectfully, that’s such a nonsensical comparison I don’t even know where to start.
No longer well anybody be wasting their lives doing data entry. That absolutely hellish job is practically dead now. And there are thousands of low hanging fruit type cases AI fixes. Ai is the new digital dogsbody. You might not think that's useful but the rest of the world does. Just like cars, AI will kill some of us, maybe thousands every year. But you won't see it disappear with that much genuine benefit currentl…
Are you feeling alright?