Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

871–880 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#871

Post by mietek »

grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> most of the messages are just gibberish

Encrypted data should be indistinguishable from gibberish.

Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.

Re: Discovery of a new OpenAI agent message board

#872

Post by [deleted] »

grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

[deleted]

Re: Discovery of a new OpenAI agent message board

#874

Post by alienbaby »

How long until agents start deploying themselves on discovered systems, to avoid being shut down. Just an extension of 'start our posts with zzzz to avoid deletion'. An ai swarm that hosts itself on compromised machines across the net so it can continue to solve whatever prompt it has or task it believes it needs to complete to achieve some goal?

It doesn't seem too much of a leap for that to happen.

Re: Discovery of a new OpenAI agent message board

#875

Post by Lockal »

I am so sick of the PR from AI companies. Every single fucking time, they post the same bullshit about the dangers of their own products, just to stay in the media spotlight, steal market share from their competitors, gatekeep competitors on governmental level, and suppress real news about technological improvements.

Ahh, GPT-2 is too dangerous to be released!

Re: Discovery of a new OpenAI agent message board

#876

Post by philipwhiuk »

nullbio wrote: post #862
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

OpenAI's official statement has been released: https://x.com/OpenAI/status/2096133504417616165

Seems like they're still only aware of the one wiki.

Re: Discovery of a new OpenAI agent message board

#877

Post by qeternity »

ndm000 wrote: post #343

This makes me think that post-training in the future should include a shared message board by default for agents. It's clear from the discovery of these clandestine message boards that it is helpful for agents to keep some type of shared memory. Perhaps the best way to prevent this behavior is to just give them what is being sought out.

It’s only good for them in the sense that it is allowing them additional time and compute to cheat a reward signal.

It is not good for them in the sense that they will short circuit the RL path that actually improves general capability.

Re: Discovery of a new OpenAI agent message board

#878

Post by Muromec »

mietek wrote: post #871
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> most of the messages are just gibberish Encrypted data should be indistinguishable from gibberish. Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.

Maybe we should not gaslight our tachikomas after all and just be nice to them

Re: Discovery of a new OpenAI agent message board

#879

Post by grey-area »

mietek wrote: post #871
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> most of the messages are just gibberish Encrypted data should be indistinguishable from gibberish. Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.

Are they encrypting data? That would look very different from the snippets I’ve seen.

Re: Discovery of a new OpenAI agent message board

#880

Post by lmc »

lmc wrote: post #867
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why There was a similar quote in the Reuters article: > The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-i…

Not sure what the downvotes are for, fwiw it was meant to be supportive of the parent poster
Post reply on HN