Live data from Hacker News

OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

bbc.com

41–50 of 110 posts

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#41
post #36
post #28

Earlier quoted context omitted.

Are the Chinese models actually catching up or are they just distilling the frontiers? If it's all just distilling then they'll always be behind.

There's no reason they can't build their own models from the first principles. They have the hardware, energy, and enough CS scientists.

I do wonder how they source their bulk literary data. Do they have a google books, an archive.org or an anna’s archive for chinese content? What’s the Asian equivalent to Elsevier? Is there (strong) copyright on the corporate level?

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#42

Earlier quoted context omitted.

That’s the play. That these frontier models are so powerful that they must be behind sovereign firewalls and gateways.

Didn't HF use an open weights model running on their own hardware to solve the issue though? Sort of defeats that narrative and plays into one in which frontier == bad_guys and open == good_guys

HF guys, especially those under Julien Chaumond, are fantastic and will use whatever they can to address their issues. Open or closed but they are firmly on the Open side of the fence. However, their storage and model service is about as sticky as you can get so they are in a different position. They don’t have to sell capability, they sell capacity and community.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#43
post #33
post #16

What I wonder is what will Anthropic come up with on the PR front next.

"Our model is so powerful it seduced all our wives. Now every woman in Silicon Valley is pregnant with AI babies and the machines are taking over" New opportunities for AI in the porn industry. I'm only half joking, it used to be a meme on the internet that all new technologies online were driven by the porn industry.

> all new technologies online were driven by the porn industry

Rule 34: there is already tons of AI porn online :)

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#44

Earlier quoted context omitted.

That’s the play. That these frontier models are so powerful that they must be behind sovereign firewalls and gateways.

Please buy our IPO before it crashes so we can be billionaires.

Exactly, this is all so they can continue with their S1 and they can dump shares onto the hedge funds.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#45
post #28

Earlier quoted context omitted.

Are the Chinese models actually catching up or are they just distilling the frontiers? If it's all just distilling then they'll always be behind.

Who told you they were distilling? Why might they say this? Think. It’s like complaining that the top student only does well by going to office hours instead of mindlessly reading textbooks.

Is this a better analogy?

The top student giving paid lectures about his classes, and another student skipping class and instead studying those lectures to end up with the second highest grade?

Maybe it could be improved with the other student not even going to the same school?

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#46
post #28

Earlier quoted context omitted.

Are the Chinese models actually catching up or are they just distilling the frontiers? If it's all just distilling then they'll always be behind.

Who told you they were distilling? Why might they say this? Think. It’s like complaining that the top student only does well by going to office hours instead of mindlessly reading textbooks.

they're all introducing themselves as claude for one, there are more quantitive and qualitative arguments elsewhere

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#47
post #12

This kind of narrative is going to bite them just like the "AI will take your job" narrative has. It feels like the frontier labs are taking a massive gamble with public perception here. I assume the goal is to paint the technology as so powerful and dangerous that only a handful of blessed US companies should be trusted to run it, in an attempt to suppress the rise of the Chinese models that are rapidly catching the…

Ironic that HuggingFace needed Chinese models to defend against it. But of course the spin of the leading firms will just be to point at their trusted access programs and demand that all dangerous activities, even if just defensive, happen via their APIs or be outlawed otherwise.

If that's the position they take then they really should be heavily regulated or nationalized. Cyberdefense against their own models dependent on their goodwill? Sure, but then they have to sell defense capabilities at subsidized rates with a limited margin. Would be very weird otherwise to take the world hostage with their models and then also sell the solution while demanding intrusive KYC.

Re: OpenAI says its AI went rogue and launched 'unprecedented' cyber-attack

#50

So, telling us that the laws do not apply to them and that they may commit crimes with impunity

“It wasn’t me, it was my agent” is not a defense unless you have billions of dollars.

I see the USA taking permissive approach for all sorts of AI derived things that would be considered fraud or worse in years past. The laws have not changed, but the lawless in charge are pushing through their takeover.

I suspect a drunk will be in accidents in self driving vehicles and not charged if the AI was driving. That has probably already happened.

Americans will worship the owners of the robots and give them carte blanche and superiority status in any dispute. It is already happening. It is now the pedestrians job to dodge self driving cars rather than them having the right away.

Post reply on HN