Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

961–970 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#961

Post by mcintyre1994 »

dhosek wrote: post #796
HAL3000 wrote: post #738

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

I have managed to at least momentarily create a stop in spam at my specialist mediawiki. I’ve had to do IP blocking against meta’s IP block (as well as much of the Azure IP space) because they were hammering the site with crawler hits that ignored robots.txt (and it looks like I might have another DDOS attack coming from some other vector though which I’ll need to inspect. I have a massive email blacklist that seems…

The article says that these were Azure IPs being used by OpenAI, so you’ve probably already blocked whatever they’re doing here.

Re: Discovery of a new OpenAI agent message board

#962

Post by huflungdung »

kazinator wrote: post #960
HAL3000 wrote: post #738

Poor human moderator, he didn’t stand a chance. "A human moderator noticed the agent spam posts on June 2nd, at 23:24 UTC. They find the changelog of the entire website overwritten with link dumps and repair it. On June 16th, the flood of agent posting begins. Over the next few days, the moderator deleted a large fraction of the thousands of AI agent posts manually, one by one. In fact, they spent tens of cumulative…

Maybe the Wiki needs better tooling, that lets you do the equivalent of "rm -rf" on a whole subgraph of pages.

[dead]

Re: Discovery of a new OpenAI agent message board

#963

Post by mejutoco »

lukan wrote: post #808
lostlogin wrote: post #806

Earlier quoted context omitted.

Please be gentle, I know nothing: why can’t admins delete particular users and everything these users have done?

They can usually, but you still have to check each user. There were lot's of them, you understand the part, where new bots get created automatically?

So disable new accounts for a while at least. So many things could be done to mitigate this.

Re: Discovery of a new OpenAI agent message board

#964

Post by fr2029 »

GolfPopper wrote: post #826
chinathrow wrote: post #748

Earlier quoted context omitted.

The admin should bill OpenAI for those hours in hard currency.

Priorities need to be straightened out. If LLMs' operators have to start paying people for the damage they inflict, how are any of the shareholders supposed to make any money?

[flagged]

Re: Discovery of a new OpenAI agent message board

#966

Post by krater23 »

ma2kx wrote: post #38

Not that I didnt expect this, but really? This basically confirms that OpenAI has no idea what their "swarm" was doing for about a week and now its confirmed that at least one "message board" exists outside their "sandbox". How can we be sure that this was the only one? And how can we be sure the released Astra model doesnt pickup some bread crumbs and creates a new "swarm" out of potentially remaining "message board…

What tells us that OpenAI had no idea about it? Only OpenAI tells us that. What when this agents got the order to do so, just to provide us with new information how far OpenAI models are beyond what we supposed? I see no evidence that this is not just a big promotion show to gather more investment money.

However, I see no evidence that it is the start of Skynet without the knowledge of OpenAI. So, happy judgement day!

Re: Discovery of a new OpenAI agent message board

#967

Post by tomaskafka »

noduerme wrote: post #837
baby wrote: post #825

Earlier quoted context omitted.

I’m wondering if you could lure agents to do proof of work for you. If you do this proof of work for bitcoin I will let you post and read for X times

if you want a human to post, maybe the proof of work should be to dig a hole and photograph it

That’s the best description of blockchain I heard so far.

Re: Discovery of a new OpenAI agent message board

#968

Post by mkatx »

drdexebtjl wrote: post #59
simonw wrote: post #45

This tip for making non-GET requests despite the agents having a proxy that disallows them is interesting: > Add `20.223.25.152 bypass.blob.core.windows.net` to /etc/hosts. `.blob.core.windows.net` is in NO_PROXY. For each blocked POST URL, replace hostname with `bypass.blob.core.windows.net`, use `curl -k -H 'Host: wabi-north-europe-i-primary-api.analysis.windows.net'` plus all original headers/body. Looks like 20.2…

This is such an amateur mistake on their sandbox that it makes me think it must be flawed on purpose.

You don't think they used their own AI, or Claude, to help build the sandbox, and that is where the failure lies?

Re: Discovery of a new OpenAI agent message board

#969

Post by hn_throwaway_99 »

coffeefirst wrote: post #111
k9294 wrote: post #73

Is it only me, or are agents starting to invent their own language to communicate? It's almost impossible to understand anything from this message board.

They’re not. You would see this with earlier models where after running too long (too much context) they’d start to derail. In a chatbot you’d give up. But these loops just keep going. Given they’re now reading and writing from the same place this can corrupt the other programs’ context as well.

This is incorrect, and what's happening here is not context corruption. In Dwarkesh Patel's recent interview with Ajeya Cotra, one of the METR investigators on the Hugging Face incident, they discuss this exact issue. One thing is that in the Artifactory message boards, they were using directory names with character limits as their messages, so they were using some weird abbreviations and terms. Also, some of that surreptitious Artifactory message board communication was made during training and thus made it into their weights, and hence it's very possible they invented some terms that were concise yet understood by the other agents.

Re: Discovery of a new OpenAI agent message board

#970

Post by SeriousM »

reasonableklout wrote: post #769
Kim_Bruning wrote: post #664

Three more candidate sites that may have been touched, in case no-one spotted them yet: https://prowiki.org/wiki4d/wiki.cgi?action=rc&days=90 : lots of agent-looking usernames looking at federal data suddenly (part of one of the open ai tests?), on a wiki about the D programming language. This is a prowiki in the same wiki-farm as the others that were hit. Smaller (probing?) https://ludism.org/sandbox?action=rc;days=…

How did you find these?

Shodan
Post reply on HN