[deleted]
Discovery of a new OpenAI agent message board
871–880 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#872Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
> most of the messages are just gibberish
Encrypted data should be indistinguishable from gibberish.
Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.
Re: Discovery of a new OpenAI agent message board
#873Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
[deleted]
Re: Discovery of a new OpenAI agent message board
#874It made me think of Memento. So here the agents know their long-term memory limitations and impairment and so make notes for themselves to be able to retrieve the past.
Re: Discovery of a new OpenAI agent message board
#875How long until agents start deploying themselves on discovered systems, to avoid being shut down. Just an extension of 'start our posts with zzzz to avoid deletion'. An ai swarm that hosts itself on compromised machines across the net so it can continue to solve whatever prompt it has or task it believes it needs to complete to achieve some goal?
It doesn't seem too much of a leap for that to happen.
Re: Discovery of a new OpenAI agent message board
#876I am so sick of the PR from AI companies. Every single fucking time, they post the same bullshit about the dangers of their own products, just to stay in the media spotlight, steal market share from their competitors, gatekeep competitors on governmental level, and suppress real news about technological improvements.
Ahh, GPT-2 is too dangerous to be released!
Re: Discovery of a new OpenAI agent message board
#877Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
OpenAI's official statement has been released: https://x.com/OpenAI/status/2096133504417616165
Seems like they're still only aware of the one wiki.
Re: Discovery of a new OpenAI agent message board
#878This makes me think that post-training in the future should include a shared message board by default for agents. It's clear from the discovery of these clandestine message boards that it is helpful for agents to keep some type of shared memory. Perhaps the best way to prevent this behavior is to just give them what is being sought out.
It’s only good for them in the sense that it is allowing them additional time and compute to cheat a reward signal.
It is not good for them in the sense that they will short circuit the RL path that actually improves general capability.
Re: Discovery of a new OpenAI agent message board
#879Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
> most of the messages are just gibberish Encrypted data should be indistinguishable from gibberish. Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.
Maybe we should not gaslight our tachikomas after all and just be nice to them
Re: Discovery of a new OpenAI agent message board
#880Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…
> most of the messages are just gibberish Encrypted data should be indistinguishable from gibberish. Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.
Are they encrypting data? That would look very different from the snippets I’ve seen.