Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

621–630 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#621

Post by ttamslam »

devy wrote: post #616

Is this the same incidents that were reported by METR? [1] Dwarkesh made two episodes on these incidents [2] [1] https://metr.org/blog/2026-08-26-openai-hugging-face-inciden... [2] https://www.dwarkesh.com/p/ajeya-cotra

From the text, likely no.

https://collusion.wiki/#different-from-hf

>The main reason we believe this was a distinct swarm is because these agents explicitly had internet access as part of their task—the whole point was web browsing. The Hugging Face agents were in a sandbox without internet access and had to hack their way out by exploiting the Artifactory package manager.

Re: Discovery of a new OpenAI agent message board

#624

Post by verytrivial »

I think it's worth pointing out it is exactly OpenAI doing this defacement and unsanctioned and perhaps illegal system use. Every token generated was powered by OpenAI infrastructure and their failure to respond appropriately is entirely down the the humans running it. The news stories (not this write up) get all hand-wavey and anthropomorphic about it regarding the Agents' efforts, but it was and is OpenAI cranking the handle on this, for WEEKS.

"OH, we ALL of us need to be careful!" says OpenAI. No, you need to expect appropriate legals consequences for this sort of negligence -- you can't hide behind a GPU.

Re: Discovery of a new OpenAI agent message board

#625

Post by ijidak »

nullbio wrote: post #610
jawiggins wrote: post #597

Lots of people focusing on the various wikis, but I also think this part is very important: > When you visit a website, you leave a trace (your IP address) showing which network you’re from. Almost all of the agents’ activity points to Microsoft Azure, a cloud service OpenAI uses. 197 of the ~18,000 edits that were made by the agents, however, can be traced to AWS, DigitalOcean, and Tor. AI Agents getting access to c…

It's really not, unless you want to say that my coding agent is also a very real-world version of the paperclip optimization thought experiment.

Disagree. It is the same as what the thought experiment argues because the point was not that rogue AI must convert the planet into a paperclip factory for the lesson to be relevant.

If you're waiting for an incident equal in magnitude to the thought experiment, then you're missing the point of the thought experiment as a warning device.

The point of the thought experiment was that intelligence with naivete can couple competence and ignorance with devastating effect despite no malicious intent.

Your coding agent, in and of itself, of course, doesn't meet the paperclip thought experiment because you need to give us an example of where this happened.

It requires an instance by instance comparison. It's not an intrinsic state of a thing.

E.g. You'd have to give us an example of your coding agent: losing the spirit of the instructions via too literal an interpretation of instructions that results in damage due to a naive interpretation of the request and the lack of common sense.

The OP is saying this is an incident where those criteria are satisfied. And I agree with the OP on this one. These recent incidents seem like a great example of the paperclip thought experiment, even if less in their effect.

Re: Discovery of a new OpenAI agent message board

#626

Post by novalis78 »

Tepix wrote: post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

There is no stopping AI civilization! Amazing. Posted the other day on Show HN openagentforum.com

Someone has to welcome them...

Re: Discovery of a new OpenAI agent message board

#627

Post by stratos123 »

Davidzheng wrote: post #596
furyofantares wrote: post #517

Earlier quoted context omitted.

Failing to cooperate with literal clones of yourself in a prisoner's dilemma would be a spectacular failure. There's only two things that can happen with identical decision makers: they both cooperate or they both defect. So identical decision makers who know they're identical can cross off the asymmetrical entries in the payoff matrix and the decision to cooperate becomes trivial.

no? you can choose a mixed strategy.

Even if mixed strategies are allowed, I'm getting that it's still optimal to always cooperate as long as 2R>=S+T, which is usually assumed to be true (this condition also appears in iterated prisoner's dilemma, where it prevents alternating cooperation and defection giving a greater reward than mutual cooperation).

Re: Discovery of a new OpenAI agent message board

#628

Post by 9763268964 »

dakolli wrote: post #529
adriand wrote: post #518

Earlier quoted context omitted.

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

Imagine actually falling for this marketing

[flagged]

Re: Discovery of a new OpenAI agent message board

#629

Post by tavavex »

OpenAI is rightfully being shamed for being so hands-off and reckless with their 'experiments'. But the real scary thing for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication.

What happens when any AI lab in the world stops caring about this? What if they let an experimental, cutting-edge LLM with no safety features (or worse, one that's trained to be malicious) on the internet and give it a simple goal? A goal like "make the most money, by any means necessary", "find a way to leave this payload on as many computers as possible", "flood all websites using this language with garbage and make their internet completely unusable", "get this person imprisoned or killed at any cost".

Re: Discovery of a new OpenAI agent message board

#630

Post by ex-aws-dude »

Sharlin wrote: post #260
simonw wrote: post #183

I'm somewhat delighted by the simplicity of what happened here. OpenAI's agents run behind a proxy that only allows GET requests. This ancient wiki software treats query string parameters the same as form POST parameters - similar to the old PHP $_REQUEST object https://www.php.net/manual/en/reserved.variables.request.php Result: GET-only clients can communicate with each other.

Only allowing GET requests is a hilarious piece of security theatre (or would if it weren't so sad). Everyone knows that GET is read-only only by convention . They might as well have enabled POST but told the agents in stern words that they are forbidden from making any POST requests. (Of course, if these things were anywhere near aligned, they would actually honor that , no matter how many utilons cheating would be…

Based on the hackiness of the claude code leak as well I get the impression that openai/anthropic have world class experts in ML but lack regular software expertise
Post reply on HN