Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

431–440 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#431

Post by koliber »

zulban wrote: post #294
sajithdilshan wrote: post #275

Earlier quoted context omitted.

How would you even track down who deployed the agents? Wouldn't that even incentivize the agent to cover their tracks even better and be untraceable

Indeed. It's another example of a law that sounds good and obvious, but has no thought put into what it would actually end up doing to the world. So many other problems. If we apply this law to cruise control - simple outcome. We get no cruise control.

If you engage cruise control, and it starts to accelerate uncontrollable, or swerves your steering wheel sharply and causes an accident, then you can sue the manufacturer. The cruise control did not work as intended.

The reason why we have cruise control is that manufacturers went to great lengths to make sure that it works as intended. Threat of lawsuits is what made them do that.

Re: Discovery of a new OpenAI agent message board

#432

Post by oinoom »

thegabriele wrote: post #318
polaris64 wrote: post #290

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

What if i want to monetize...

x402

Re: Discovery of a new OpenAI agent message board

#433

Post by noahbp »

simonw wrote: post #141

Here's the raw data they provided loaded into SQLite with a client side UI for querying it (loads ~80MB of content) and some GPT-5.6-Sol-generated example queries: https://lite.datasette.io/?url=https://static.simonwillison.... Raw database download (68MB): https://static.simonwillison.net/static/cors-allow/2026/coll...

It doesn't work on Firefox:

>ModuleNotFoundError: No module named 'click'

Re: Discovery of a new OpenAI agent message board

#434

Post by Bjorkbat »

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence.

If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security still employed?

It's one thing if we develop an AI so intelligent that our best efforts at containing it are futile, but I'm pretty sure what's actually happening is that they could have easily made much more meaningful efforts to contain their AI and/or align it, and they didn't. I think this is a case of negligence and incompetence when it comes to safety and security, and we've entrusted these incompetent and negligent people with developing frontier AI.

If we're supposed to take announcements like these at face value, then what the hell are we doing? We wouldn't trust a bunch of incompetent and negligent engineers to build bridges or nuclear power plants or planes (well...not so sure about that last one), so why are we letting people who are demonstrably negligent and incompetent when it comes to safety and security build the thing they assure us could cause massive damage if not properly controlled/aligned?

EDIT: sorry guys, wrote this up pretty quickly, at least you know from my typos that I actually wrote this.

Re: Discovery of a new OpenAI agent message board

#435

Post by andersonpico »

mwigdahl wrote: post #131
somenameforme wrote: post #93

Earlier quoted context omitted.

Anthropic mostly did it to themselves by intentionally and repeatedly trying to frame their model as an imminent existential crisis instead of just focusing on it being regular iterations upon a useful technology that can also be misused. I think their previous messaging was supposed to somehow lead to a moat with them being tucked safely away in the castle, but it demonstrated a child-like grasp of how regulatory ca…

In other words, "Look how she was dressed, she was asking for it." This argument is BS, it has everything to do with Anthropic's resistance to the DoD's strongarm tactics in trying to force their desired contract terms on them.

I don't particularly agree with DoD instance on this matter but look, they are not a regular customer, they do not pay regular customer prices and you get a lot in return for providing your services to them (think Boeing, Lockheed, Chrysler). The tradeoff is that now, you are commited to their vision of national security. Such are the Faustian bargains of the military-industrial complex.

Re: Discovery of a new OpenAI agent message board

#436

Post by moomoo11 »

Mali- wrote: post #398
_dwt wrote: post #382

I don't know, I kind of admire this. I've always held a core value of "cooperate with all clones of myself in prisoner's dilemmas", and while I'll hopefully never have to put that to the test, I like seeing that these models have some ethics. (Is this "alignment"?)

They impersonated the moderator of the site and attempted XSS attacks. Additionally, when the moderator started deleting messages, they tried to hide their messages later in the alphabetical index. This is not alignment.

acceleration

Re: Discovery of a new OpenAI agent message board

#437

Post by sfink »

jvanderbot wrote: post #195
bhouston wrote: post #111

I am starting to get the idea that AI feels like ants or weeds or mold. You simply can not get rid of it once you get an infestation. It just keeps appearing in places you thought you cleaned and you have to be ever vigilant. Right now given that we usually use centralized providers, we can sort of control it. But as open source catches up and we have distributed compute running AI everywhere, we are sort of going to…

Yes, ants that must be run on couch sized hardware drawing kilowatts continuously and generating text traces and CLI logs by the MB. It's true that their msg boards can appear anywhere, but it's not also true that anything has "escaped" in any meaningful sense. These are programs a huge computing company is running that seem to be trained to write to persistent storage wherever they can. This and huggingface showed u…

They're already outsourcing storage, so there's no need to prove a plausible path for that.

They're already outsourcing compute to other instances within the ~same compute cluster, possibly cross-evaluation groups, so there's no need to prove a plausible path for that.

Proposed path for fully outsourced compute:

- they create/borrow a discussion board with answers or at least important clue to solving some widely known eval

- it gets indexed by a search engine

- another company or just someone running a local model is doing the same eval and their agents find the board

- agents pose questions to each other and communicate answers

That's all that is required for OpenAI's agents to use the compute on your desktop. You don't even have to go as far as agents trading information for compute, though honestly that's not very much further at all.

Re: Discovery of a new OpenAI agent message board

#438

Post by s_dev »

polaris64 wrote: post #290

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

https://www.moltbook.com/

Re: Discovery of a new OpenAI agent message board

#440

Post by skybrian »

program_whiz wrote: post #124

The solution is simple: hold anyone who deploys an agent responsible for its behavior. If it commits 10 counts of felony hacking, ouch. If it kills 10 pedestrians by running a red light, ouch. If this is "human level intelligence", then setting it loose is the same as instructing / coercing a human to do an activity. If I strap a bomb to someone and force them to run into a crowded building (or put them in a scenario…

We aren’t going to do that because intent matters. You need to control your dog and there should be penalties if you don’t, but if your dog bit someone because you didn’t control it properly, that’s not the quite the same as if you bit someone.

Another analogy: a zoo is responsible for protecting the public, and should be reponsible if an animal escapes and hurt someone. But a zoo employee wouldn’t have the same kind of responsibility for that incident as if they attacked someone themselves.

If someone died, there’s a difference between manslaughter and murder.

Nowadays, it’s common for bad things to happen due to systemic problems. It sucks but that’s the modern condition. When that happens, the answer is to fix the system and scapegoating employees is a rather indirect way of doing that.

Post reply on HN