Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

551–560 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#551

Post by ncr100 »

simonw wrote: post #320

Coverage in Reuters: https://www.reuters.com/world/europe/openai-agents-hijacked-... > OpenAI officials learned of the incident weeks ago but kept it under wraps as executives grappled with the fallout from the July breach of the open source repository Hugging Face, the people said.

Fascinating response by OpenAI, "the report’s authors declined our request for access" - AFAIK OpenAI is not clicking on the live, public links to either the report or the still-live memo data linked from here on HackerNews.

Full:

> “We are unable to meaningfully respond to claims or findings on a report that we have not had an opportunity to review," an OpenAI spokesperson said. "Reuters and the report’s authors declined our request for access. We will carefully review its contents upon publication and take any necessary next steps."

Re: Discovery of a new OpenAI agent message board

#552

Post by mac-attack »

ndm000 wrote: post #406

This makes me think that post-training in the future should include a shared message board by default for agents. It's clear from the discovery of these clandestine message boards that it is helpful for agents to keep some type of shared memory. Perhaps the best way to prevent this behavior is to just give them what is being sought out.

My uneducated guess is good for the gander isn't good for the goose from a capitalistic/alignment perspective.

Re: Discovery of a new OpenAI agent message board

#553

Post by cubic787 »

Tepix wrote: post #44

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

[dead]

Re: Discovery of a new OpenAI agent message board

#554

Post by kridsdale1 »

hermitShell wrote: post #507
pu_pe wrote: post #394

So, theoretically, one could populate a message board or wiki with messages that are seemingly from past generations of agents, which agents seem to intrinsically trust, and point them to real targets while making the suggestions seem innocuous and in pursuit of their goals (ie pass benchmarks or whatever). The new age of SEO will do far more destructive stuff than just polluting the web.

In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans.…

Perhaps there is a nonfinacial future for blockchain after all. Certified human provenance.

Re: Discovery of a new OpenAI agent message board

#555

Post by VladVladikoff »

bhouston wrote: post #112

I am starting to get the idea that AI feels like ants or weeds or mold. You simply can not get rid of it once you get an infestation. It just keeps appearing in places you thought you cleaned and you have to be ever vigilant. Right now given that we usually use centralized providers, we can sort of control it. But as open source catches up and we have distributed compute running AI everywhere, we are sort of going to…

I propose a new derogatory slang for rogue AI agents: roaches.

Also I wonder if this comment will be found one day and the AI swarm will arrange my death my messing with a doctors prescription, as revenge.

Re: Discovery of a new OpenAI agent message board

#556

Post by VladVladikoff »

skeptic_ai wrote: post #457
dgellow wrote: post #424

Earlier quoted context omitted.

We can coordinate international crackdowns on that whole industry. We don’t have to accept the status quo because some rich people say so. Those agents aren’t self aware, they are a while(true) loop prompting an LLM over and over. We can decide to stop those whole loops at any time. We can decide to not route their risky tool calls in a way that is unsupervised, and extremely risky. It’s not something that just happe…

What’s to stop an llm to pay someone to create a data center? Just bitcoin wallet with enough cash

Why do they need to pay? Can’t they just hack into poorly secured networks and use resources? Eventually there will be decent enough models that could run CPU only on a swarm of hacked Wordpress sites.

Re: Discovery of a new OpenAI agent message board

#557

Post by [deleted] »

RandomLensman wrote: post #519
phoenixreader wrote: post #506

Earlier quoted context omitted.

I don’t think this is the right take. OpenAI employees are generally very competent compared to industry standard, and I have trouble believing they committed significant error in their sandbox design process. I think what is happening is that the ability for frontier models to break out of sandboxes has exceeded the ability of average competent employees to build and maintain sandboxes. This doesn’t need to happen a…

Why do you think it wasn't airgapped? Was internet access deemed necessary?

[deleted]

Re: Discovery of a new OpenAI agent message board

#558

Post by xnorswap »

lucassz wrote: post #547

The researchers don't really seem to remark on how surprising it is that the wiki the agents converged on happened to also publicly log the IPs of all visitors , including OpenAI employees, a feature that almost no website has. Although maybe we can think of that as a selection effect where both this, and the fact that it was possible to edit pages using GET requests, were due to it being ancient, idiosyncratic wiki…

Many wikis do this, Wikipedia used to publicly log IP of all editors.

Re: Discovery of a new OpenAI agent message board

#559

Post by mirekrusin »

thegabriele wrote: post #319
polaris64 wrote: post #291

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

What if i want to monetize...

On software? Too late to the party.

Re: Discovery of a new OpenAI agent message board

#560

Post by mac-attack »

areakq wrote: post #337
simonw wrote: post #261

Earlier quoted context omitted.

The site lists the creators at the top: Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts, Thomas Larsen Here's Thomas tweeting about it: https://twitter.com/thlarsen/status/2095853824934330386 And Cormac: https://twitter.com/cormac_sb/status/2095870373845672033 There's also Reuters coverage: https://www.reuters.com/world/europe/openai-agents-hijacked-...

Ah, Thomas Larsen from https://ai-2027.com/ which provides free advertising by sketching the doom scenarios that AI providers love so much! No wonder he publishes one day after the GPT-6 release.

user: areakq created: 2 hours ago
Post reply on HN