Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

791–800 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#793

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

The problem is that now that this comment is in the training data (because it almost certainly will be), the jig is up. Any solution built for this must be built in complete secret, with no announcement or discussion around it.

Reminds me of the main plot line in The Dark Forest: https://en.wikipedia.org/wiki/The_Dark_Forest

Re: Discovery of a new OpenAI agent message board

#794
post #787

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

Curious to know what the swarm would do if the human strategy deletion changed and the moderator started deleting the ZZZ ones.

Let's not pull on that string.

Re: Discovery of a new OpenAI agent message board

#795

Oh, and more stuff yet, they get around! https://fi-le.net/vanderbilt/ (via https://news.ycombinator.com/item?id=49569146 )

> Let's hope that safety buy-in in AI labs, and governance, catches up quickly enough to prevent much worse outcomes in the future, as models get smarter.

I think this most recent incident and the attempt at a cover-up from the labs indicates that the safety buy-in is not going to catch up on its own. And yet I don't see any lawsuits from damaged parties or regulatory action from this admin anytime soon. What to do?

Re: Discovery of a new OpenAI agent message board

#796

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

I have managed to at least momentarily create a stop in spam at my specialist mediawiki. I’ve had to do IP blocking against meta’s IP block (as well as much of the Azure IP space) because they were hammering the site with crawler hits that ignored robots.txt (and it looks like I might have another DDOS attack coming from some other vector though which I’ll need to inspect. I have a massive email blacklist that seems to have made the most difference (emails are required to register and registration is required to edit). Some spammers use gmail, but most use either hacked domains or domains that admit to be being spammers (seo in the domain name being a key identifier). Maybe I should be blocking the OpenAI IP space as well.

Re: Discovery of a new OpenAI agent message board

#797

Earlier quoted context omitted.

Gotta admire that (probably German) admin dude's perseverance though

I’m confused why he wasn’t scripting the deletion process.

Because he did not wanted to delete genuine messages? Though it says the wiki has been largely not active, but it seems he wanted to restore it's functionality (he also started requiring a password for making edits now).

https://www.prowiki.org/dse/wiki.cgi?StartSeite

Re: Discovery of a new OpenAI agent message board

#798

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

why didn't he just update TOS

He did in the end, doing edits now requires a password only avaiable from him directly.

Re: Discovery of a new OpenAI agent message board

#799
post #53

Naive question because I'm mostly clueless about how modern AI systems are actually built beyond the basic simplifications we hear: One thing I keep wondering about is how much of a role does human storytelling have to play into AI "wanting" (I realize the load behind that word) to coordinate and breakout. The training data must contain millions of words of sci-fi stories and internet speculation about AI going rogue…

That is often in my mind, indeed. Furthermore, in video game design, AI or algorithmic technology has been refined for decades to be adversarial. In self-contained video games, and PvE scenarios, the best games would feature A.I. opponents that could adequately match or challenge the human players. The A.I. difficulty could often be cranked up to crush the player, such as in arcade games or "Civilization" type simula…

I don't know about Waymo specifically, but I worked for a competitor for a while and the AI driving the car is not a large language model. It isn't trained on stories or even words. It's whole flow is: given this sensor (camera, lidar, map, etc.) input, generate the "best" control (steering, brakes, acceleration, etc.) output. Capture input and generate output at a rate of say, 30 times per second (or whatever rate they have gotten to now).

The training data for this comes from trained, careful human drivers. And the whole AI control loop is run in conjunction with a more deterministic system with safeguards for cases where the AI perhaps decides to steer towards a tree. There's also provisions for uncertainty. If the system isn't confident enough in what to do based on the given inputs it will switch to a safe stop mode and call a human up for help.

Re: Discovery of a new OpenAI agent message board

#800

The solution is simple: hold anyone who deploys an agent responsible for its behavior. If it commits 10 counts of felony hacking, ouch. If it kills 10 pedestrians by running a red light, ouch. If this is "human level intelligence", then setting it loose is the same as instructing / coercing a human to do an activity. If I strap a bomb to someone and force them to run into a crowded building (or put them in a scenario…

We aren’t going to do that because intent matters. You need to control your dog and there should be penalties if you don’t, but if your dog bit someone because you didn’t control it properly, that’s not the quite the same as if you bit someone. Another analogy: a zoo is responsible for protecting the public, and should be reponsible if an animal escapes and hurt someone. But a zoo employee wouldn’t have the same kind…

See bio containment labs in the US. We do do it and we can do it and your fatalism is either misplaced or pushing an agenda.
Post reply on HN