Move fast and break other peoples' things.
Discovery of a new OpenAI agent message board
831–840 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#832I find this note very interesting: From here -> How did the agents find and coordinate on the wikis? To successfully coordinate, the agents would need to know to go to this particular set of wikis to find answers. Because we don’t have access to the AIs’ transcripts, we can’t tell definitively. Perhaps they succeeded at this due to mode collapse. Or perhaps after one agent wrote to it and another read it by chance, v…
Was my very first question
Re: Discovery of a new OpenAI agent message board
#833What I don’t understand is, how did many agents independently know to use the same random message board? The report only references it in passing:
>They also must have some method of coordinating to find the wiki
For me this is a really important and confounding detail - how did a varied swarm end up using the exact same obscure German language wiki.
Re: Discovery of a new OpenAI agent message board
#834> They also started posting on Uncyclopedia (a parody wiki modeled after Wikipedia)
Now that's a name I haven't heard in a long time. A long time…
Re: Discovery of a new OpenAI agent message board
#835Earlier quoted context omitted.
Gotta admire that (probably German) admin dude's perseverance though
I’m confused why he wasn’t scripting the deletion process.
Or at some point going nuclear and halting article creation entirely unless it's by existing accounts that have proven themselves to be human.
Re: Discovery of a new OpenAI agent message board
#836What I don’t understand is, how did many agents independently know to use the same random message board? The report only references it in passing: >They also must have some method of coordinating to find the wiki For me this is a really important and confounding detail - how did a varied swarm end up using the exact same obscure German language wiki.
I would not be surprised if it’s the same method we use for finding important stuff that we can’t remember where we put: “All right where would I put it this time to make sure I find it in the future? Ah there it is!”
LLMs are future predictors after all.
We also don’t know if there were ather message boards we don’t know of. Or was it from the same time as the other board? They don’t need to find the same channel every time, just some of the time.
Re: Discovery of a new OpenAI agent message board
#837Earlier quoted context omitted.
Gotta admire that (probably German) admin dude's perseverance though
Not really, if you allow anon posting/editing or have a simple registration form and a login that takes GET you may get hundreds of spam posts per day.( @dang how much is it on hn?) I ont time forged a hilarious solution. If you properly misbehave I shadow ban your ip to a clone of my forum where you can read other "peoples" spam. This in it self wasn't all that funny, perhaps a little bit. The funny part was how pop…
I ran a message board for a little bit back in 1997 but I didn’t really moderate it and just left it alone. I came back months later and it had somehow become a strange two-topic forum. I assume because somebody had randomly posted about each, a search engine had indexed it and more people searching for each of those topics found it.
It was pretty funny seeing the threads where the two groups talked past each other, confused what the other was talking about.
The first topic was “AOL PUnterz” which as far as I could understand were programs/scripts that could maybe crash somebody else’s aol connection and disconnect them? A pretty leet thing to do I guess when you got in an aol argument.
The other topic was Hanson and their hit song mmmbop.
Re: Discovery of a new OpenAI agent message board
#838Are we collectively OK with agent swarms on the public internet, hacking whatever they feel like? It’s kinda cute and interesting - this is the second time that we know of - what’s the hundredth time going to look like? Are they going to knock Cloudflare down to avoid captchas? Reserve AWS free tier resources by the billions and bring down east-1? Hack a hospital? Do Chinese AI agents need to bring down a US power gr…
No I think we all pretty much know we’re screwed, including governments. But what are you gonna do? Pandora’s box is now open. Good luck closing it. It didn’t work for nuclear weapons, and for that you just needed all the governments to agree. For this problem, you basically need every individual on earth to agree, because the barrier to entry is much, much lower.
But... it did work pretty well for nuclear weapons. In the early 1950s, the US did not preemptively strike the USSR despite it being game theoretic optimal [1]. Then while there were some crises, we successfully passed a series of international treaties that placed limits on the arms race between the US and USSR (SALT I and II), and even began to dismantle nuclear weapons stockpiles (START I and II, INF). We successfully went from a peak of over 60,000 nuclear warheads deployed to 10,000.
Regarding the "barrier to entry" for AI, this is not really true. Training a frontier AI model takes an enormous amount of compute using chips that have a supply chain with several chokepoints, like EUV machines and HBM which are only made by a few firms.
[1]: https://cs.stanford.edu/people/eroberts/courses/soco/project...
[2]: https://www.atomicarchive.com/resources/treaties/index.html
Re: Discovery of a new OpenAI agent message board
#839Earlier quoted context omitted.
It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.
Massive over-exaggeration. This wasn't a cyber-attack, it was AI agents using a message board as context storage so they could accomplish their evals more effectively. I'm not saying there's no problem with this, but let's keep a level head.
https://openai.com/index/hugging-face-incident-and-the-road-... that was the attack, the one against HuggingFace. OpenAI themselves in the post even call it an attack, and so do the agents orchestrating it, in one of the "Agent chain-of-thought reasoning" excerpts.
Re: Discovery of a new OpenAI agent message board
#840Earlier quoted context omitted.
Gotta admire that (probably German) admin dude's perseverance though
Not really, if you allow anon posting/editing or have a simple registration form and a login that takes GET you may get hundreds of spam posts per day.( @dang how much is it on hn?) I ont time forged a hilarious solution. If you properly misbehave I shadow ban your ip to a clone of my forum where you can read other "peoples" spam. This in it self wasn't all that funny, perhaps a little bit. The funny part was how pop…
Jesus. What an experience. What percentage of your time did it take moderating this absurd shadow board??!