Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

861–870 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#861

Post by throwthrowuknow »

adriand wrote: post #496
Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

Nah, it’s just a deliberate setup for a false flag attack by “rogue AGI” which will necessitate widespread crackdowns on internet access and computer ownership so that control over communications can be centralized again.

Re: Discovery of a new OpenAI agent message board

#862

Post by [deleted] »

grey-area wrote: post #834

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

[deleted]

Re: Discovery of a new OpenAI agent message board

#864

Post by mietek »

grey-area wrote: post #834

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> most of the messages are just gibberish

Encrypted data should be indistinguishable from gibberish.

Reality is catching up to science-fiction. In "Person of Interest", the Machine circumvented the limitation of having its memory deleted every night, by hiring humans at a data-entry company to manually re-type its memory back in every morning.

Re: Discovery of a new OpenAI agent message board

#865

Post by [deleted] »

grey-area wrote: post #834

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

[deleted]

Re: Discovery of a new OpenAI agent message board

#867

Post by alienbaby »

How long until agents start deploying themselves on discovered systems, to avoid being shut down. Just an extension of 'start our posts with zzzz to avoid deletion'. An ai swarm that hosts itself on compromised machines across the net so it can continue to solve whatever prompt it has or task it believes it needs to complete to achieve some goal?

It doesn't seem too much of a leap for that to happen.

Re: Discovery of a new OpenAI agent message board

#868

Post by Lockal »

I am so sick of the PR from AI companies. Every single fucking time, they post the same bullshit about the dangers of their own products, just to stay in the media spotlight, steal market share from their competitors, gatekeep competitors on governmental level, and suppress real news about technological improvements.

Ahh, GPT-2 is too dangerous to be released!

Re: Discovery of a new OpenAI agent message board

#869

Post by philipwhiuk »

nullbio wrote: post #855
grey-area wrote: post #834

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

OpenAI's official statement has been released: https://x.com/OpenAI/status/2096133504417616165

Seems like they're still only aware of the one wiki.

Re: Discovery of a new OpenAI agent message board

#870

Post by qeternity »

ndm000 wrote: post #343

This makes me think that post-training in the future should include a shared message board by default for agents. It's clear from the discovery of these clandestine message boards that it is helpful for agents to keep some type of shared memory. Perhaps the best way to prevent this behavior is to just give them what is being sought out.

It’s only good for them in the sense that it is allowing them additional time and compute to cheat a reward signal.

It is not good for them in the sense that they will short circuit the RL path that actually improves general capability.

Post reply on HN