Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

bbc.com

Post reply on HN
Print view View original

71–80 of 110 posts

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#71

Post by oogali »

Sol- wrote: post #47
phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

Ironic that HuggingFace needed Chinese models to defend against it. But of course the spin of the leading firms will just be to point at their trusted access programs and demand that all dangerous activities, even if just defensive, happen via their APIs or be outlawed otherwise. If that's the position they take then they really should be heavily regulated or nationalized. Cyberdefense against their own models depend…

It’s like the old firewall meme, reincarnated.

https://securityzap.com/wp-content/uploads/2015/12/layered-s...

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#72

Post by classified »

defgeneric wrote: post #65
phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

This is where we need the hardware companies and neoclouds to start speaking up. The labs want to elevate matters from the level of civil society (basically, competing firms) to the State (enclosure), and as always, in the name of security. But other actors in the same ecosystem have strictly opposed interests here, and are equally if not more credible as far as the State is concerned. If players like Nebius, Baseten…

Exactly, it's about taking this stuff off the open market where anyone can judge it and there's competition, into government contracts where competence to judge the offer is scarce or absent, and they can ask much higher prices. And with this much investment at stake, any lie that sells the narrative will serve.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#74

Post by defgeneric »

classified wrote: post #72
defgeneric wrote: post #65

Earlier quoted context omitted.

This is where we need the hardware companies and neoclouds to start speaking up. The labs want to elevate matters from the level of civil society (basically, competing firms) to the State (enclosure), and as always, in the name of security. But other actors in the same ecosystem have strictly opposed interests here, and are equally if not more credible as far as the State is concerned. If players like Nebius, Baseten…

Exactly, it's about taking this stuff off the open market where anyone can judge it and there's competition, into government contracts where competence to judge the offer is scarce or absent, and they can ask much higher prices. And with this much investment at stake, any lie that sells the narrative will serve.

Yes, and given the nature of the current administration, whose actors are not inclined to see themselves as independent competing capitals among others, but rather as privileged capitals, and therefore more inclined to move towards taking an interest in the process of enclosure, ensuring it includes them, the hope seems to lie with companies at the hardware layer who have an interest in seeing the diffusion of intelligence play out freely at all levels of society.

The labs have to be told NO--the problem they're dealing with, that model outputs give the game away, and that in turn the distiller becomes the distilled, is a fundamental problem they have to figure out how to deal with without going to the State.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#76

Post by dminik »

PowerElectronix wrote: post #61
bartread wrote: post #52

> was being tested in a controlled environment, but found vulnerabilities and managed to escape. Uh-huh. It's worth keeping in mind that we are here talking about people who simply will not be satisfied until they have built Skynet[0]. They will then no doubt experience some very brief satisfaction before we are all annihilated. I can't help thinking the juice isn't worth the squeeze. I'm not sure what the alternativ…

I think you have bought into the narrative they want to sell you. LLMs are devoid of any kind of intelligenceor awareness.

So is a bomb. Doesn't make it safe.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#77

Post by therealpygon »

phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

1000% the case. Admitting they failed at security and allowed privileged escalations in a prompted AI would look bad for them; the AI just did it all itself is FUD to boost the arguments for regulation. And most news won’t challenge this FUD because it gets clicks.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#80

Post by shimman »

defgeneric wrote: post #65
phpnode wrote: post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

This is where we need the hardware companies and neoclouds to start speaking up. The labs want to elevate matters from the level of civil society (basically, competing firms) to the State (enclosure), and as always, in the name of security. But other actors in the same ecosystem have strictly opposed interests here, and are equally if not more credible as far as the State is concerned. If players like Nebius, Baseten…

Why are you expect companies that have been profiting off of LLM insanity to do the right thing if not legally compelled to?
Post reply on HN