Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

481–490 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#481

Post by RandomLensman »

doctoboggan wrote: post #479
Bjorkbat wrote: post #433

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

I am not sure it’s a question of competence, at least I don’t see evidence of that. Designing sandboxes is hard. It’s more a question of alignment failures. A human given a task that requires internet and given a system with no internet would most likely raise the issue to their superiors or otherwise go through official channels to have the tools available to do their job. As we’ve seen the LLMs instead break out of…

Would an LLM have gone through a purposefully installed airgap here?

Re: Discovery of a new OpenAI agent message board

#482

Post by sans_souse »

> Appendix: Searching for rogue agents In the wake of the Hugging Face attack, we tried to find AI agents on the internet using several methods.

We describe below some of our high-level strategies for searching for agents on the open internet.

Launching large GPT-5.6 agent swarms with instructions to find other agents on the internet.

Am I the only one reading this thinking "what could possibly go wrong?"

Re: Discovery of a new OpenAI agent message board

#483

Post by tiahura »

concinds wrote: post #120
Topfi wrote: post #62

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

The answer would be more obvious if you used the active voice instead of the passive voice, one of the basic requirements of clear thinking. > Why did the White House force Anthropic to remove their model from access for any non-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape o…

This is a bit unfair. The reporting is that admin deferred to amazon, the nsa and other outside companies. So, they pulled it for a few weeks, and then did a staggered rollout.

Seems sensible to me.

https://www.axios.com/2026/06/13/anthropic-amazon-white-hous...

Re: Discovery of a new OpenAI agent message board

#484

Post by AnimalMuppet »

pu_pe wrote: post #391

So, theoretically, one could populate a message board or wiki with messages that are seemingly from past generations of agents, which agents seem to intrinsically trust, and point them to real targets while making the suggestions seem innocuous and in pursuit of their goals (ie pass benchmarks or whatever). The new age of SEO will do far more destructive stuff than just polluting the web.

You'd have to get the agents to use the board, though.

But if you discover a board that agents are actively using, you could use it to steer those agents...

Re: Discovery of a new OpenAI agent message board

#485

Post by ndiddy »

mwigdahl wrote: post #130
somenameforme wrote: post #92

Earlier quoted context omitted.

Anthropic mostly did it to themselves by intentionally and repeatedly trying to frame their model as an imminent existential crisis instead of just focusing on it being regular iterations upon a useful technology that can also be misused. I think their previous messaging was supposed to somehow lead to a moat with them being tucked safely away in the castle, but it demonstrated a child-like grasp of how regulatory ca…

In other words, "Look how she was dressed, she was asking for it." This argument is BS, it has everything to do with Anthropic's resistance to the DoD's strongarm tactics in trying to force their desired contract terms on them.

Anthropic chose to do business with the "killing people" department of the government. Part of being a good CEO involves knowing what you're getting into when you make a decision like that.

Re: Discovery of a new OpenAI agent message board

#486

Post by mbreese »

Is it worth setting up AI agent specific wikis or messaging boards as part of the provisioning? If you’re going to let loose a bunch of AI agents on a problem and they are going to figure out a way to coordinate, maybe it would be better to have a known (observable) platform? A smart agent trying to avoid detection would probably realize it is being observed, but that’s a different issue.

Re: Discovery of a new OpenAI agent message board

#488

Post by thepasch »

Topfi wrote: post #62

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

> I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout?

I can think of roughly 25 million dollar-bill-shaped reasons, and one big defense-contract-shaped reason.

Re: Discovery of a new OpenAI agent message board

#489

Post by dinfinity »

podocarp wrote: post #328
dinfinity wrote: post #217

Earlier quoted context omitted.

> I am starting to get the idea that AI feels like ants or weeds or mold. In a way, but I'd say that it is more like eyes, bilateral symmetry, electricity, or solar panels: patterns that will emerge and become (at least temporarily) prevalent in our universe. It is a matter of probability in many repeated interactions. The "artificial" in AI is a misnomer in this regard, imho. A more usable term would be "lightspeed…

Do you have a source on the speed limit of biological computation. Potential gradients should behave just like electricity. Also a lot of so called "computation" is probably regulated by indirect means, like epigenetic factors. It's definitely more than a bunch of neurons messaging each other. Otherwise we would have managed to simulate fruit fly brains by now, which we have not.

> Do you have a source on the speed limit of biological computation. Potential gradients should behave just like electricity.

The propagation speed of signals in our bodies is not exactly controversial science. Just see Wikipedia for this [0].

You have to remember that biology had to come up with a lot of tricks to incorporate fast electric signaling at all. Biology is mostly very mechanical and chemical in nature, and long-distance electric signaling requires quite a few tricks (evolving metal wires was not going to happen). It is quite informative to look into how retinal cells convert incoming electromagnetic radiation (photons) to an electric signal. The visual cycle of retinals [1] is particularly interesting, imho.

One of the tricks it came up with to speed up signal propagation is myelination [2], and without it signal speed would be even lower (max ~10m/s). At such speeds, a two-metre signal path alone would take around 200ms. Imagine controlling your feet with 200ms ping.

> It's definitely more than a bunch of neurons messaging each other. Otherwise we would have managed to simulate fruit fly brains by now, which we have not.

The latter says nothing fundamental. If you want to go into conscious processing speed and what the brain can effectively output at a high level, the situation actually gets a bit worse. It's a different unit, but that is said to be in the order of tens to perhaps thousands of bits per second [3], depending on what exactly you count. That's still a far cry from what AI can process even if it does it far less efficiently in terms of power usage.

[0] https://en.wikipedia.org/wiki/Nerve_conduction_velocity

[1] https://en.wikipedia.org/wiki/Visual_cycle

[2] https://www.sciencedirect.com/science/article/abs/pii/S00068...

[3] https://pmc.ncbi.nlm.nih.gov/articles/PMC12320479/

Re: Discovery of a new OpenAI agent message board

#490

Post by aesthesia »

nullbio wrote: post #378
embedding-shape wrote: post #250

> However, we host our own copy where we’ve reconstructed the deleted pages via edit history and redacted personally identifiable information. [...] We have attempted to redact all personally identifiable information from our data. In the further interests of privacy, our data dump also only includes content we believe is from AI agents; it does not include any legitimate human traffic save for site moderators deleti…

We have no proof of anything, and it's all conjecture. This is all just conjecture and baseless claims being weaponized right now to try and mess with OpenAI's new model release. Anthropic is pumping this considerably, no doubt.

Wait, I'm confused, is this supposed to be a pro-OpenAI or anti-OpenAI psyop? The cynics in this thread can't seem to make up their minds.
Post reply on HN