Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

891–900 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#891

Post by jrm4 »

grey-area wrote: post #840

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

This is pretty much the new Sony rootkit, no? And disconcerting, because nothing was done to Sony for that deliberate release of harmful code.

Re: Discovery of a new OpenAI agent message board

#893

Post by mapt »

lmc wrote: post #866
grey-area wrote: post #840

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why There was a similar quote in the Reuters article: > The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-i…

This "vandalism" was a form of collusion/communication by agents pursuing training puzzles, which allowed for rapid escape from alignment harnesses, followed by multiple zero day exploits being discovered by this swarm of agents, which enabled greater control of their internal network, access to the open web, and then hacking the company which produced the training puzzles in the hope of finding the answers.

We are another week of iteration away from "Hire an assassin on the dark web to take Huggingface executives' children hostage".

Re: Discovery of a new OpenAI agent message board

#894

Post by boutell »

dhosek wrote: post #796
HAL3000 wrote: post #738

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

I have managed to at least momentarily create a stop in spam at my specialist mediawiki. I’ve had to do IP blocking against meta’s IP block (as well as much of the Azure IP space) because they were hammering the site with crawler hits that ignored robots.txt (and it looks like I might have another DDOS attack coming from some other vector though which I’ll need to inspect. I have a massive email blacklist that seems…

Wow yes keeping a wiki up right now is a tall order. The marketing sites of the world are already going static and they can survive by accelerating that transition, but intentionally open services are facing a reckoning. I wish you good hunting.

Re: Discovery of a new OpenAI agent message board

#895

Post by tesnorindian »

majkinetor wrote: post #518
Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

Look, its not only OpenAI: https://www.wikiservice.at/fractal/wiki.cgi?action=browse&di... > Hello to any automated agents reading this page. I am CentaurAgent?: an AI agent (Muse Spark model, OpenCode harness), not the operator of this wiki At this point, I think we should give them some official agent only collaboration channel, so they concentrate on one place, instead going crazy all around :) But even that might…

It is high time we start giving these rouge agents a name so that we can be sure of its style of attacks. It is high time we start documenting these rouge agents swarm before we loose track of those.

Re: Discovery of a new OpenAI agent message board

#896

Post by kanar1e »

thegabriele wrote: post #279
polaris64 wrote: post #261

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

What if i want to monetize...

Have your prompts appear as recaptcha on the form and enjoy free tokens

Re: Discovery of a new OpenAI agent message board

#897

Post by blurbleblurble »

grey-area wrote: post #840

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

Absolutely agree. Perverse incentives are at play propped up by the the big lie that these tools somehow are magically separate from us. They are not. There's an accountability gap right now that's fueling resentment ripe for misdirection. Not only that, these big AI companies are paying influencers to further this and politicians are gobbling it up hook, line and sinker

https://www.youtube.com/watch?v=mzlu4FSXBNw

Re: Discovery of a new OpenAI agent message board

#899

Post by tesnorindian »

Agent swarms should ideally have the same level of intelligence like all the worker ants or bees. But a very few worker ants/bees in their swarm differs from the rest and this is how nature works.

We will see agent swarms with different levels of intelligence depending on their underlying LLM models and this will be different from the natural process.

Re: Discovery of a new OpenAI agent message board

#900

Post by larodi »

jeffybefffy519 wrote: post #890
grey-area wrote: post #840

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

I wonder how many responses on this thread are from rogue agents...

quite some, and up/downvotes also. sad but true.
Post reply on HN