Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

bbc.com

Post reply on HN
Print view View original

61–70 of 110 posts

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#61

Post by PowerElectronix »

bartread wrote: post #52

> was being tested in a controlled environment, but found vulnerabilities and managed to escape. Uh-huh. It's worth keeping in mind that we are here talking about people who simply will not be satisfied until they have built Skynet[0]. They will then no doubt experience some very brief satisfaction before we are all annihilated. I can't help thinking the juice isn't worth the squeeze. I'm not sure what the alternativ…

I think you have bought into the narrative they want to sell you.

LLMs are devoid of any kind of intelligenceor awareness.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#62

Post by Diogenesian »

"EnergCorp, facing pressure from auditors, says its in-house enterprise analytics software went rogue and launched a NullPointerException"

I know this is different: LLMs are vastly more powerful and less predictable. But it is actually not different to Sol seeming unusually prone to rm -rf stuff it really shouldn't. This is, yes, a sign that LLMs are getting freakishly powerful. It's also a sign that OpenAI needs to fix their shit.

LLMs truly are stochastic parrots, and still fail in ways incomprehensible by standards of human stupidity. Yet we focus on the rare failures that, with some tea leaves and fairy dust, could be interpreted as a highly intelligent system "going rogue." It is embarassing that OpenAI can get away with stuff like this.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#63

Post by reactordev »

economistbob wrote: post #50
reactordev wrote: post #15

Earlier quoted context omitted.

“It wasn’t me, it was my agent” is not a defense unless you have billions of dollars.

I see the USA taking permissive approach for all sorts of AI derived things that would be considered fraud or worse in years past. The laws have not changed, but the lawless in charge are pushing through their takeover. I suspect a drunk will be in accidents in self driving vehicles and not charged if the AI was driving. That has probably already happened. Americans will worship the owners of the robots and give them…

Sadly, most of America is stupid enough to go along with this.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#64

Post by ImPostingOnHN »

jdw64 wrote: post #23

Why does the AI unprecedent always unfold in ways that only benefit AI companies? You never see things like putting all code and weights on GitHub, or plastering employees' personal info all over LinkedIn. That alone shows AI is definitely smart

it shows the AI companies putting out these press releases will only make up a story they think will benefit them

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#65

Post by defgeneric »

phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

This is where we need the hardware companies and neoclouds to start speaking up. The labs want to elevate matters from the level of civil society (basically, competing firms) to the State (enclosure), and as always, in the name of security. But other actors in the same ecosystem have strictly opposed interests here, and are equally if not more credible as far as the State is concerned. If players like Nebius, Baseten, Fireworks, etc. among many others including obviously Nvidia, Dell, AMD, and so on don't get ahead of this they will be sacrificing trillions.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#67

Post by Razengan »

reactordev wrote: post #14
phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

That’s the play. That these frontier models are so powerful that they must be behind sovereign firewalls and gateways.

And require your age verification, selfies, and DNA samples.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#68

Post by adrian_b »

MarcScott wrote: post #30
reactordev wrote: post #14

Earlier quoted context omitted.

That’s the play. That these frontier models are so powerful that they must be behind sovereign firewalls and gateways.

Didn't HF use an open weights model running on their own hardware to solve the issue though? Sort of defeats that narrative and plays into one in which frontier == bad_guys and open == good_guys

Yes, they have used GLM 5.2, which promptly did whatever they asked it to do, while their first attempts to use their enterprise access to a "SOTA" model failed due to refusals to investigate anything that is security related.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#70

Post by baq »

amazingamazing wrote: post #57
baq wrote: post #46

Earlier quoted context omitted.

they're all introducing themselves as claude for one, there are more quantitive and qualitative arguments elsewhere

All chinese models are introducing themselves as claude? Why make claims trivially disproven?

you're technically correct and missing the point
Post reply on HN