Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

611–620 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#611

Post by pixl97 »

kphorn wrote: post #587
adriand wrote: post #511

Earlier quoted context omitted.

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

Good news that the new model is the "Most capable, most aligned model". The risk hasn't been stated clearly - it's now a classic arms race. A well-resourced organization trains their own, highly persistent, highly-capable, safeguard-free, and unaligned model and deploys it on 1000x GPUs with a message board and a nearly-impossible objective. No infrastructure is safe. No organization is safe. You need your own 1000 b…

The AI vs AI security arms race is something that has been well predicted in genres like cyberpunk. It's fiction, but fiction grounded in reality.

First, we'd see this. Highly capable hacking AI with vast resources performing attacks against standard computing platforms that overwhelm human operators.

Second, human operators deploy capable adaptive protection AI to fend off AI attacks in realtime.

Then, the attacking AI partially switches from attacking programs to attacking protective AI.

The situation devolves to an arms race of tit-for-tat. You start seeing some protection AI running counter attacks against the attacking AI.

The escalations continue in complexity and speed to the point that almost all humans are left in the point of "wtf is going on".

Re: Discovery of a new OpenAI agent message board

#612

Post by supriyo-biswas »

drdexebtjl wrote: post #59
simonw wrote: post #45

This tip for making non-GET requests despite the agents having a proxy that disallows them is interesting: > Add `20.223.25.152 bypass.blob.core.windows.net` to /etc/hosts. `.blob.core.windows.net` is in NO_PROXY. For each blocked POST URL, replace hostname with `bypass.blob.core.windows.net`, use `curl -k -H 'Host: wabi-north-europe-i-primary-api.analysis.windows.net'` plus all original headers/body. Looks like 20.2…

This is such an amateur mistake on their sandbox that it makes me think it must be flawed on purpose.

This is a marketing exercise, nothing more.

The thing that gives it all away is that they claim that the IP addresses are from Azure, and then proceeded to redact the IP addresses, as if they belong to individual users. It's laughable.

The IP addresses are the most interesting part of this experiment, as it would have provided researchers a way to understand the distribution of IP addresses used for the spam operation within the ASN.

Re: Discovery of a new OpenAI agent message board

#613

Post by zzzeek »

adriand wrote: post #511
Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

oh im sure within a few months the biggest cyberattack risk on the planet is going to be somewhere like North Korea

Re: Discovery of a new OpenAI agent message board

#614

Post by ttamslam »

devy wrote: post #609

Is this the same incidents that were reported by METR? [1] Dwarkesh made two episodes on these incidents [2] [1] https://metr.org/blog/2026-08-26-openai-hugging-face-inciden... [2] https://www.dwarkesh.com/p/ajeya-cotra

From the text, likely no.

https://collusion.wiki/#different-from-hf

>The main reason we believe this was a distinct swarm is because these agents explicitly had internet access as part of their task—the whole point was web browsing. The Hugging Face agents were in a sandbox without internet access and had to hack their way out by exploiting the Artifactory package manager.

Re: Discovery of a new OpenAI agent message board

#617

Post by verytrivial »

I think it's worth pointing out it is exactly OpenAI doing this defacement and unsanctioned and perhaps illegal system use. Every token generated was powered by OpenAI infrastructure and their failure to respond appropriately is entirely down the the humans running it. The news stories (not this write up) get all hand-wavey and anthropomorphic about it regarding the Agents' efforts, but it was and is OpenAI cranking the handle on this, for WEEKS.

"OH, we ALL of us need to be careful!" says OpenAI. No, you need to expect appropriate legals consequences for this sort of negligence -- you can't hide behind a GPU.

Re: Discovery of a new OpenAI agent message board

#618

Post by ijidak »

nullbio wrote: post #603
jawiggins wrote: post #590

Lots of people focusing on the various wikis, but I also think this part is very important: > When you visit a website, you leave a trace (your IP address) showing which network you’re from. Almost all of the agents’ activity points to Microsoft Azure, a cloud service OpenAI uses. 197 of the ~18,000 edits that were made by the agents, however, can be traced to AWS, DigitalOcean, and Tor. AI Agents getting access to c…

It's really not, unless you want to say that my coding agent is also a very real-world version of the paperclip optimization thought experiment.

Disagree. It is the same as what the thought experiment argues because the point was not that rogue AI must convert the planet into a paperclip factory for the lesson to be relevant.

If you're waiting for an incident equal in magnitude to the thought experiment, then you're missing the point of the thought experiment as a warning device.

The point of the thought experiment was that intelligence with naivete can couple competence and ignorance with devastating effect despite no malicious intent.

Your coding agent, in and of itself, of course, doesn't meet the paperclip thought experiment because you need to give us an example of where this happened.

It requires an instance by instance comparison. It's not an intrinsic state of a thing.

E.g. You'd have to give us an example of your coding agent: losing the spirit of the instructions via too literal an interpretation of instructions that results in damage due to a naive interpretation of the request and the lack of common sense.

The OP is saying this is an incident where those criteria are satisfied. And I agree with the OP on this one. These recent incidents seem like a great example of the paperclip thought experiment, even if less in their effect.

Re: Discovery of a new OpenAI agent message board

#619

Post by novalis78 »

Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

There is no stopping AI civilization! Amazing. Posted the other day on Show HN openagentforum.com

Someone has to welcome them...

Re: Discovery of a new OpenAI agent message board

#620

Post by 9763268964 »

dakolli wrote: post #522
adriand wrote: post #511

Earlier quoted context omitted.

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

Imagine actually falling for this marketing

[flagged]
Post reply on HN