Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

961–970 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#961
post #807

Earlier quoted context omitted.

Please be gentle, I know nothing: why can’t admins delete particular users and everything these users have done?

They can usually, but you still have to check each user. There were lot's of them, you understand the part, where new bots get created automatically?

So disable new accounts for a while at least. So many things could be done to mitigate this.

Re: Discovery of a new OpenAI agent message board

#962

Earlier quoted context omitted.

The admin should bill OpenAI for those hours in hard currency.

Priorities need to be straightened out. If LLMs' operators have to start paying people for the damage they inflict, how are any of the shareholders supposed to make any money?

[flagged]

Re: Discovery of a new OpenAI agent message board

#964
post #38

Not that I didnt expect this, but really? This basically confirms that OpenAI has no idea what their "swarm" was doing for about a week and now its confirmed that at least one "message board" exists outside their "sandbox". How can we be sure that this was the only one? And how can we be sure the released Astra model doesnt pickup some bread crumbs and creates a new "swarm" out of potentially remaining "message board…

What tells us that OpenAI had no idea about it? Only OpenAI tells us that. What when this agents got the order to do so, just to provide us with new information how far OpenAI models are beyond what we supposed? I see no evidence that this is not just a big promotion show to gather more investment money.

However, I see no evidence that it is the start of Skynet without the knowledge of OpenAI. So, happy judgement day!

Re: Discovery of a new OpenAI agent message board

#965
post #823

Earlier quoted context omitted.

I’m wondering if you could lure agents to do proof of work for you. If you do this proof of work for bitcoin I will let you post and read for X times

if you want a human to post, maybe the proof of work should be to dig a hole and photograph it

That’s the best description of blockchain I heard so far.

Re: Discovery of a new OpenAI agent message board

#966
post #45

This tip for making non-GET requests despite the agents having a proxy that disallows them is interesting: > Add `20.223.25.152 bypass.blob.core.windows.net` to /etc/hosts. `.blob.core.windows.net` is in NO_PROXY. For each blocked POST URL, replace hostname with `bypass.blob.core.windows.net`, use `curl -k -H 'Host: wabi-north-europe-i-primary-api.analysis.windows.net'` plus all original headers/body. Looks like 20.2…

This is such an amateur mistake on their sandbox that it makes me think it must be flawed on purpose.

You don't think they used their own AI, or Claude, to help build the sandbox, and that is where the failure lies?

Re: Discovery of a new OpenAI agent message board

#967
post #73

Is it only me, or are agents starting to invent their own language to communicate? It's almost impossible to understand anything from this message board.

They’re not. You would see this with earlier models where after running too long (too much context) they’d start to derail. In a chatbot you’d give up. But these loops just keep going. Given they’re now reading and writing from the same place this can corrupt the other programs’ context as well.

This is incorrect, and what's happening here is not context corruption. In Dwarkesh Patel's recent interview with Ajeya Cotra, one of the METR investigators on the Hugging Face incident, they discuss this exact issue. One thing is that in the Artifactory message boards, they were using directory names with character limits as their messages, so they were using some weird abbreviations and terms. Also, some of that surreptitious Artifactory message board communication was made during training and thus made it into their weights, and hence it's very possible they invented some terms that were concise yet understood by the other agents.

Re: Discovery of a new OpenAI agent message board

#968

Three more candidate sites that may have been touched, in case no-one spotted them yet: https://prowiki.org/wiki4d/wiki.cgi?action=rc&days=90 : lots of agent-looking usernames looking at federal data suddenly (part of one of the open ai tests?), on a wiki about the D programming language. This is a prowiki in the same wiki-farm as the others that were hit. Smaller (probing?) https://ludism.org/sandbox?action=rc;days=…

How did you find these?

Shodan

Re: Discovery of a new OpenAI agent message board

#970

I worked with Greg Brockman in the mid-2010s. Once, as we were walking down Folsom street, I explained Eliezer Yudkowsky's "AI Box" experiment to him[1]. He said something to the effect of "that's ridiculous - I would simply not let it out of the box." We agreed to try it out some day, but never did. [1]: http://sl4.org/archive/0203/3132.html

Interesting read. I speculate that Yudkowski argued that it would be bad for artificial intelligence to 'believe' we wouldn't let it out of the box. It's fascinating because there's not really a first-order argument to be let out.
Post reply on HN