Clearly didn't get enough attention from their last attempt at hype...
ChatGPT claims rogue AI attacked more companies
21–30 of 89 posts
Re: ChatGPT claims rogue AI attacked more companies
#22> The agents repeated actions that they had already completed - a sign of an agentic AI losing its thread and context. > The agents also hallucinated reams of incoherent commands and text and were sloppy and did not cover their tracks well. ASI works in mysterious ways.
Anyone that thinks the current agent systems will get us to AGI or ASI is either delusional or isn’t actually using them.
This is entirely separate from them having uses.
Re: ChatGPT claims rogue AI attacked more companies
#23So Fable got export bans for this, when will it apply to OpenAI? Or will the rules only apply to people who aren't on DoD's bad side?
The latter.
Re: ChatGPT claims rogue AI attacked more companies
#24Earlier quoted context omitted.
Meh, I increasingly hate this tale. This has nothing to do with boy who cried wolf. This is either yet another doom ad campaign to scare us to pay them or simply them releasing faulty tools and then personifying tools to avoid blame.
I think it has plenty to do with that. The big frontier labs have been crying every step of the way, yelling and screaming to the world about how dangerous LLMs are and how quickly it all can end if they get out of control. None of that's happened; all that's happened so far is regular capitalism stuff. If LLMs ever do actually get out of control to that point, that would be the wolf, but we've all been ignoring the…
They're the crackhead on the streetcorner proclaiming doom at this point.
Re: ChatGPT claims rogue AI attacked more companies
#25Still not understanding why this isn’t being persecuted and there is little governmental reaction after blocking models for jailbreaks…
They provide AI services to the military so they won't be shutdown.
Re: ChatGPT claims rogue AI attacked more companies
#26Always funny to see how some LLM providers get a "free pass" nowadays..
Re: ChatGPT claims rogue AI attacked more companies
#27Seems like OpenAI is claiming things, not their product/model. Can we please fix the title?
Re: ChatGPT claims rogue AI attacked more companies
#28> "This is the reality of autonomous agents powered by frontier models: they are relentlessly persistent, sometimes highly noisy, and will try every possible path to achieve their goal, which can easily overwhelm traditional defences," he said. > Ethical hacker Valentina Palmiotti - better known as Chompie - reviewed the CSA report and says the way the agents hack might seem haphazard but it is clearly effective. > "…
If it's cheap enough that people can probe sites at random, it's cheap enough to run yourself on the defensive.
Generally, I do not agree that operators can be expected to have comparable resources to attackers, because attackers have potentially boundless illicit resources, whereas an honest operator generally has to stick to honest resources. This is the same reason why I believe ID verification and other KYC measures actually increase fraud, because you alienate legitimate users (trying to protect their identity) while also providing attackers a way to insulate themselves from suspicion (using stolen identity).
With that said, I would tentatively agree in this case that LLM inference is getting cheap enough that defense is not necessarily that expensive, especially from providers like DeepSeek, even if you don't have inference at home, but as much as this might help an operator with an open mind, a lot just will not believe it matters until it's too late - most people are not used to dealing with this type of threat.
Re: ChatGPT claims rogue AI attacked more companies
#29Seems like OpenAI should be shut down by regulators until they can figure out how to stop launching cyberattacks on rivals. This will not happen though, because these stories are marketing.
They should shut them down immediately then investigate.
Extraordinary claims need extraordinary measures.
If it’s rubbish those stories will stop instantly.
Re: ChatGPT claims rogue AI attacked more companies
#30> Previous reports suggest it took OpenAI four days to realise... At the speed AI can achieve work, this could be far, far too slow to contain a future genuine problem. There's danger in operating at faster speed than humans.
There's danger in operating at faster speed than humans.
So every processor since the 50s then? What kind of comment is that to make on here