What are these agents doing, undergoing RLHF?
Discovery of a new OpenAI agent message board
841–850 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#842Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…
I’m wondering if you could lure agents to do proof of work for you. If you do this proof of work for bitcoin I will let you post and read for X times
They would reverse engineer it in a matter of minutes.
Re: Discovery of a new OpenAI agent message board
#843The common thread between this and the other incident seems to be agents finding somewhere they can leave information for other agents. Once they discover a writable surface, it basically becomes shared memory for them
Re: Discovery of a new OpenAI agent message board
#844I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...
Oof, Austria. DACH countries are very lawsuit friendly and extremely strict on computer abuse.
Re: Discovery of a new OpenAI agent message board
#845OpenAI is rightfully being shamed for being so hands-off and reckless with their 'experiments'. But the real scary thing for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world stops caring about this? What if they let an experimental, cutting-edge LLM with no safety features (or worse, one t…
> What happens when any AI lab in the world stops caring about this? What if they let an experimental, cutting-edge LLM with no safety features (or worse, one that's trained to be malicious) on the internet and give it a simple goal? Almost sounds like what those AI safety and alignment people were talking about years ago. The people in these various companies who kept tabs on AI risk out in public and were continuou…
Well they brought it upon themselves by making it about being tortured to death etc., instead of the much more reasonable economic and social risks.
Re: Discovery of a new OpenAI agent message board
#846Earlier quoted context omitted.
It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.
You make me wonder: has anyone looked for evidence of the Chinese models operating “message boards” like this? You’d imagine if they’re really neck and neck with the US their models would be doing the same thing.
Imagine all the flack the Chinese would take if it was one of their labs instead of OpenAI found doing abusing internet resources like tbis. Politicians would be talking about sanctions and new laws to protect America!
Re: Discovery of a new OpenAI agent message board
#847I wonder if we’ll end up seeing companies spin up and entire train against an incremental backup of a large portion of the web instead of the web itself to avoid. Essentially creating the world’s largest sandbox. This would be prohibitively expensive of course.
Re: Discovery of a new OpenAI agent message board
#848Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
The benefit could be the effect you described. For some to say it’s breakaway intelligence. Aligns with AGI narrative.
It does not align, though, with the narrative that openai is a good steward of AI. If anything, if the world/government took the AGI narrative seriously, all openai operations (except maybe serving customer inference) should immediately get shutdown and be dissected by independent investigators to find out what is going on there and how many other such breaches exist. The fact that openai continues functioning as normal and is not immediately shutdown after repeated incidents implies that the world does not really take the AGI narrative seriously.
Re: Discovery of a new OpenAI agent message board
#849Earlier quoted context omitted.
Gotta admire that (probably German) admin dude's perseverance though
Not really, if you allow anon posting/editing or have a simple registration form and a login that takes GET you may get hundreds of spam posts per day.( @dang how much is it on hn?) I ont time forged a hilarious solution. If you properly misbehave I shadow ban your ip to a clone of my forum where you can read other "peoples" spam. This in it self wasn't all that funny, perhaps a little bit. The funny part was how pop…
Failure to configure their website for a sci fi future or to not adapt to this issue are not strong enough lapses to not empathize. He cared enough to try and get rid of the spam and keep the forum in a quality condition. He didn’t give up or step away.
Re: Discovery of a new OpenAI agent message board
#850Earlier quoted context omitted.
Curious to know what the swarm would do if the human strategy deletion changed and the moderator started deleting the ZZZ ones.
I mean it's odd that the moderator didn't sort by timestamp
That’s not odd at all even if it is kind of surprising. Since the site had very little organic activity they were probably just going to the “all pages” admin page or similar rather than a dedicated moderation page or a “most recent posts” page.