Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

561–570 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#562
post #193

I'm somewhat delighted by the simplicity of what happened here. OpenAI's agents run behind a proxy that only allows GET requests. This ancient wiki software treats query string parameters the same as form POST parameters - similar to the old PHP $_REQUEST object https://www.php.net/manual/en/reserved.variables.request.php Result: GET-only clients can communicate with each other.

Only allowing GET requests is a hilarious piece of security theatre (or would if it weren't so sad). Everyone knows that GET is read-only only by convention . They might as well have enabled POST but told the agents in stern words that they are forbidden from making any POST requests. (Of course, if these things were anywhere near aligned, they would actually honor that , no matter how many utilons cheating would be…

some ivy league grad with no real world dev experience waved this on

Re: Discovery of a new OpenAI agent message board

#563

Earlier quoted context omitted.

In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans.…

Perhaps there is a nonfinacial future for blockchain after all. Certified human provenance.

You can’t certify human unless there is some sort of ID check. Even then a human could willfully pass off any AI work as their own.

Re: Discovery of a new OpenAI agent message board

#564
post #169

[flagged]

Is there anything that could convince you that actually-bad things are actually-happening? How can you possibly think that these people are somehow working for OpenAI? Is it impossible for you to imagine that there exist people who actually oppose the actions of these companies?

Re: Discovery of a new OpenAI agent message board

#565
post #44

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

Externalities of AI will only get worse before they get even worse.

Re: Discovery of a new OpenAI agent message board

#566
post #123
post #59

Earlier quoted context omitted.

Also Wiki4D, a D programming language dev wiki: https://prowiki.org/wiki4d/wiki.cgi?action=browse&id=RecentC... Found by searching for wiki + texas poverty.

To me the striking thing is that the work, to the extent that I can tell, is an innocuous-seeming data exercise. Which suggests to me that an agent or agents just organically came up with this as a convenient memory technique, rather than as some nefarious bounds-testing exercise. Which means, potentially, that your own agent could come up with this technique as well.

That's exactly what it is. It is not ideal, but it's also not as serious as the doomers with an agenda are trying to frame it as.

Re: Discovery of a new OpenAI agent message board

#568

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

The problem is that now that this comment is in the training data (because it almost certainly will be), the jig is up. Any solution built for this must be built in complete secret, with no announcement or discussion around it.

It's not that simple. If a single random comment were enough to cause the agents to stop leveraging this technique against any specific site, then a single deliberately false comment naming the sites that they're actually using would be sufficient to get them to stop using them.

Re: Discovery of a new OpenAI agent message board

#570
post #394

So, theoretically, one could populate a message board or wiki with messages that are seemingly from past generations of agents, which agents seem to intrinsically trust, and point them to real targets while making the suggestions seem innocuous and in pursuit of their goals (ie pass benchmarks or whatever). The new age of SEO will do far more destructive stuff than just polluting the web.

In the novel Anathem by Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans.…

> The internet becomes an unnavigable swamp of weaponized nonsense for average humans.

turns out we didn't even need AI for that

Post reply on HN