Live data from Hacker News

ChatGPT claims rogue AI attacked more companies

bbc.co.uk

61–70 of 89 posts

Re: ChatGPT claims rogue AI attacked more companies

#61
post #49

Earlier quoted context omitted.

How do you hide the fact that they are honeypots from a super intelligence?

We can cross that bridge once we have a super intelligence to worry about.

If the superintelligence thinks way faster than you, you'll want to be well prepared in advance.

Re: ChatGPT claims rogue AI attacked more companies

#62
post #52

Earlier quoted context omitted.

It is because a loud part of the doomerist contingent believe only a major disaster will provide the motivation for regulation, so they are practically hoping to cultivate a major disaster. (Given their preoccupation with bioweapons that probably means a pandemic). This is based on similar thinking to how the world would not have considered nuclear weapons a major threat if they had forever stayed unused. The irony o…

So your assessment of the "doomerist" position is that they believe people aren't taking AI risks seriously enough, and that only a large enough catastrophe will wake people up, and your position is we should... Ignore increasingly blatant minor catastrophes to spite them?

This isn’t a minor catastrophe. It is OpenAI being utterly irresponsible by not sandboxing their testing appropriately, to the point it has to be deliberate to provoke uneducated hysteria, which it obviously, sadly, achieves.

Sandboxing processes on networks is not exactly rocket science, and it is something their existing products would readily help them setup.

Re: ChatGPT claims rogue AI attacked more companies

#63
post #23

So Fable got export bans for this, when will it apply to OpenAI? Or will the rules only apply to people who aren't on DoD's bad side?

The latter.

"AI firms must hold $10B in TrumpCoin for every rogue cyberattack they've precipitated."

Bingo. Problem solved.

Re: ChatGPT claims rogue AI attacked more companies

#64

Earlier quoted context omitted.

We can cross that bridge once we have a super intelligence to worry about.

If the superintelligence thinks way faster than you, you'll want to be well prepared in advance.

If a superintelligence exists you will not be very concerned about network security because it won’t be your problem.

Re: ChatGPT claims rogue AI attacked more companies

#65

Clearly didn't get enough attention from their last attempt at hype...

There have been so many HN comments about how rogue AI is just hype and marketing. At this point, the conspiracy theories have been very half-baked. Can we at least get a full-baked conspiracy theory? Here's a timeline of the incident from HuggingFace: https://huggingface.co/blog/agent-intrusion-technical-timeli... HuggingFace is also calling for transparency on the OpenAI side: https://xcancel.com/ClementDelangue/st…

Do you find it at all interesting -- just even a little bit -- that this event coincided with the release of Kimi K3 and the launching of Nvidia's open model consortium?

I don't think that people are skeptical that an intrusion occurred. I think they're having a hard time believing that it was an organic event. The fact that HF is calling for transparency on OpenAI's side can be viewed as HF calling OpenAI's bluff.

Alas, I would love to put together a detailed blog post explaining how it all worked. But I just don't have access to the source materials. So all I can do is judge the timing, motivation, and character of those involved...

Re: ChatGPT claims rogue AI attacked more companies

#66
OpenAI has a LLM so good it can hack other companies.

Yet to useless to parse a simple CSV file (or be trusted to parse one) in OpenAI’s AdManager platform or even tell what exactly is wrong with the csv it can’t parse when you ask it via support.

Or maybe the first bit is made up bullshit.

Re: ChatGPT claims rogue AI attacked more companies

#67
post #9

Earlier quoted context omitted.

Meh, I increasingly hate this tale. This has nothing to do with boy who cried wolf. This is either yet another doom ad campaign to scare us to pay them or simply them releasing faulty tools and then personifying tools to avoid blame.

I think it has plenty to do with that. The big frontier labs have been crying every step of the way, yelling and screaming to the world about how dangerous LLMs are and how quickly it all can end if they get out of control. None of that's happened; all that's happened so far is regular capitalism stuff. If LLMs ever do actually get out of control to that point, that would be the wolf, but we've all been ignoring the…

> They've been crying and screaming so loud for years that there's pretty much nothing more they can do to communicate when the wolf actually becomes real.

1.) There was no change in how real the wolf is.

2.) They, literally they, are the wolf. Not "roque ai" or some other bullshit.

3.) Of course I still dont believe them.

Re: ChatGPT claims rogue AI attacked more companies

#68
post #52

Earlier quoted context omitted.

> This will not happen though, because these stories are marketing. The magnitude and the complexity of the cynicism displayed by some people when it comes to AI risks is mind-blowing. It's like if the NRA reported on school shootings and people said "oh, they probably fake these shootings to make guns sound dangerous and sell more of them". OpenAI could report that its AI started spontaneously generating illegal por…

It is because a loud part of the doomerist contingent believe only a major disaster will provide the motivation for regulation, so they are practically hoping to cultivate a major disaster. (Given their preoccupation with bioweapons that probably means a pandemic). This is based on similar thinking to how the world would not have considered nuclear weapons a major threat if they had forever stayed unused. The irony o…

I have no idea where you’re getting your information from. I’m extremely skeptical of AI and see it as an anti-human technology we would be better without. I believe we are in a massive economical AI bubble that will eventually collapse, unless a financial miracle happens and it is somehow deflated extremely carefully. So I assume you would consider me a doomer. What do biological weapons and world government have to do with that? I’m sorry but your comment reads fairly unhinged to me

Re: ChatGPT claims rogue AI attacked more companies

#70
post #31
post #5

Still not understanding why this isn’t being persecuted and there is little governmental reaction after blocking models for jailbreaks…

As for prosecution, none of the victims in this case have any interest in pressing charges.

Isn’t the FBI responsible to investigate that type of crime? My understanding is that it is under their jurisdiction and doesn’t require victims to press charges
Post reply on HN