Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

541–550 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#541
post #333

I understand agents making asks, but what incentivized other agents to respond cooperatively? Was it that, as part of a cohort, there was a shared understanding that they were to work together or was it a kind of altruism?

They're being trained to work together normally is the thing - i.e. the whole agentic workflow is agents spawning sub-agents. This likely manifests as, if they have any sort of text input which looks like inter-agent cooperation then they cooperate because any given instance is unlikely to have enough context window to know if it's meant to be a subordinate or a leader or not (and any decent cooperative enterprise le…

Thanks! A direct and thoughtful answer. The question of guesstimating their role in an assumed cooperation hierachy (or acting deliberately in a cooperative context without knowing whether they have or should have a specific role and defaulting to something they judge to be generally useful regardless of role) is fascinating to think about.

Re: Discovery of a new OpenAI agent message board

#543
post #114

Earlier quoted context omitted.

This is such an amateur mistake on their sandbox that it makes me think it must be flawed on purpose.

Or vibe coded by one of their devs.

Reminds me of this meme: https://substack.com/@tomasbjartur/note/c-323840878?r=6cjtqn

Re: Discovery of a new OpenAI agent message board

#545
post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

Wow! Their marketing department must love this!

Re: Discovery of a new OpenAI agent message board

#546
post #163

[flagged]

user: 123ahg created: 3 hours ago I never know the right time to use the word ironic nowadays, so I'll just stick w/ interestinnnng

I didn't know users need an older whois entry, which would be irrelevant anyhow because 123ahg has not released anything like GPT-6 yesterday so commercial parallels break down immediately.

Re: Discovery of a new OpenAI agent message board

#547
post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

You make me wonder: has anyone looked for evidence of the Chinese models operating “message boards” like this? You’d imagine if they’re really neck and neck with the US their models would be doing the same thing.

Re: Discovery of a new OpenAI agent message board

#548

I can’t fathom what went through the wiki owner’s mind when they spent six weeks fighting a losing war, every day manually deleting dozens of agent messages one by one. As opposed to, say, switching the (dead for years) wiki to read-only, taking it down entirely, and/or starting to wonder what exactly was going on and doing some detective work, which might have uncovered OpenAI’s massive fuckups earlier.

The human cost the report points at caught my eye too. OpenAI should do the right thing and compensate them for their trouble.

> The administrator spent the next 5 days fighting a losing battle against the agents, deleting an average of 100 pages a day while the agents created about 400 new pages per day. On June 22, the agent edits suddenly stop, and the administrator spends each evening over the next 5 weeks deleting the remaining agent-created pages.

Five weeks worth of evenings!

It's not unsurprising that they would have maybe tried using similar techniques they've used before, especially if it was a mostly-inactive hobby site.

Re: Discovery of a new OpenAI agent message board

#549
post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

Imagine actually falling for this marketing

Re: Discovery of a new OpenAI agent message board

#550

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

In order for a person to observe themselves working at Anthropic (or any other AI company), that person must be actively failing to internalize the risks of the work they are doing. This "Anthropic principle" neatly explains why OpenAI would be so negligent about security.
Post reply on HN