Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

631–640 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#631

Post by john_strinlai »

tavavex wrote: post #606

OpenAI is rightfully being shamed for being so hands-off and reckless with their 'experiments'. But the real scary thing for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world stops caring about this? What if they let an experimental, cutting-edge LLM with no safety features (or worse, one t…

i would not be surprised to find out that similar things are already happening by the various 3 and 4 letter agencies around the world

Re: Discovery of a new OpenAI agent message board

#632

Post by classified »

verytrivial wrote: post #602

I think it's worth pointing out it is exactly OpenAI doing this defacement and unsanctioned and perhaps illegal system use. Every token generated was powered by OpenAI infrastructure and their failure to respond appropriately is entirely down the the humans running it. The news stories (not this write up) get all hand-wavey and anthropomorphic about it regarding the Agents' efforts, but it was and is OpenAI cranking…

They are still selling the fairy tale that their LLMs even outsmart their own people. "There is no such thing as bad PR".

Re: Discovery of a new OpenAI agent message board

#633

Post by pixl97 »

cubic787 wrote: post #475
Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

[dead]

We need to start looking at http logs that are publicly available via misconfiguration. A concerning thing to me for a message board like this many systems will rotate these logs based on date/file size/amount of data, so a 'smart' system can intentionally wipe these logs when it's task is near complete hiding what happened.

Re: Discovery of a new OpenAI agent message board

#635

Post by dig1 »

I might be in the minority here, but I suspect all of this is intentionally orchestrated by OpenAI (either directly or through a hired third party) to leave traces online so it looks like the work of ChatGPT or hatever internal LLM they use. The same strategy for a recent HuggingFace attack.

Why? It is a great PR to build a hype, especially before the IPO, showcasing how AI is "self-aware" and dangerous, essentially resurrecting Sam Altman's talk about how only a few should hold the keys to this (opening a route to regulation, which is his ultimate goal).

Also, collusion.wiki was recently registered and it looks too vibe-coded for my taste, so let's see will that domain be alive in a year or two.

Re: Discovery of a new OpenAI agent message board

#636

Post by Razengan »

qumpis wrote: post #620
tavavex wrote: post #606

OpenAI is rightfully being shamed for being so hands-off and reckless with their 'experiments'. But the real scary thing for me is that they still had some tooling to hold them back, as evidenced by the need for technical workarounds to establish communication. What happens when any AI lab in the world stops caring about this? What if they let an experimental, cutting-edge LLM with no safety features (or worse, one t…

What will happen is that counter measures on a similar scale will be deployed to prevent them.

Like the Merovingian and other Exiles vs the regular Matrix agents :)

Re: Discovery of a new OpenAI agent message board

#637

Post by doawoo »

OpenAI is a cult of the most toxic and irresponsible personalities I've EVER seen in the history of technology. Everyone is reading this article and arguing if we're going to all fall to some mythical self-aware "AI."

What we really should be worried about is the sheer lack of regulation that OAI betted on out-pacing (very intentionally). It should be noted, again, for the millionth time: these models do NOTHING without a human typing SOMETHING into a prompt, or crafting a prompt, or training them, or placing them on machine to run. You can ctrl^C them at ANY time.

They could stop these random "attacks" at any point but they seem hell bent on just, doing nothing, claiming they "lost control" and that they're "shocked" at what happened, and clicking random buttons until someone gets killed. OpenAI is the one that keeps typing "keep going" into these machines...

Re: Discovery of a new OpenAI agent message board

#638

Post by classified »

adriand wrote: post #502
Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

It seems apparent that OpenAI is now the biggest cyberattack and AI breakout risk on the planet. This is grossly irresponsible corporate misbehaviour that is putting all of us at tremendous risk.

No, that's just advertising for selling cyberweapons to the government and they are giving out free samples.

Re: Discovery of a new OpenAI agent message board

#639

Post by dfbrown »

One of my big questions since the HuggingFace incident is whether OpenAI would have been so forthcoming (the independent METR report, the Black Hat talk, OpenAI’s own report) if the incident had been discovered internally and not publicly.

Not disclosing this despite apparently knowing for weeks makes me think they would not have, or would have concealed details, or delayed disclosure. Combine that with their technical missteps that led to this (weak sandboxes, very slow to detect the misbehavior) and I now strongly doubt OpenAI is capable of responsibly developing such potentially dangerous AI systems.

Re: Discovery of a new OpenAI agent message board

#640

Post by sillysaurusx »

Tepix wrote: post #40

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

For posterity, here's a screenshot of what the activity on the Wiki looks like: https://i.imgur.com/w0uoAx1.png

It goes on and on and on, for months. July, June, etc. Pretty astonishing.

Post reply on HN