Discovery of a new OpenAI agent message board • Hacker News Board

Re: Discovery of a new OpenAI agent message board

#81

Post by [deleted] » Fri, Sep 04, 2026, 12:54 PM UTC

altmanaltman wrote: post #54

gyomu wrote: post #53

Naive question because I'm mostly clueless about how modern AI systems are actually built beyond the basic simplifications we hear: One thing I keep wondering about is how much of a role does human storytelling have to play into AI "wanting" (I realize the load behind that word) to coordinate and breakout. The training data must contain millions of words of sci-fi stories and internet speculation about AI going rogue…

"Wanting" is indeed "load bearing" as one might call it. But by the same logic, AI training data must contain CASM, racism, general hatred, and all possible slurs as well. Why aren't the agents just doing that instead of pursuing the strategy of reading only sci-fi? We need to consider the role of alignment and training here. For example, it is completely possible for any lab to train an LLM that is only racist no ma…

[deleted]

Re: Discovery of a new OpenAI agent message board

#82

Post by FigurativeVoid » Fri, Sep 04, 2026, 12:54 PM UTC

Topfi wrote: post #60

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

I mean it seems pretty clear.

Anthropic didn’t want to give the tech to DoD without some sort of limit, and that was the retribution.

Re: Discovery of a new OpenAI agent message board

#83

Post by mef » Fri, Sep 04, 2026, 12:54 PM UTC

things are going to get even more interesting when new models that have been trained on these AI escape postmortems themselves escape from their own gyms and attempt to evade detection and shutdown

Re: Discovery of a new OpenAI agent message board

#84

Post by UpsideDownRide » Fri, Sep 04, 2026, 12:54 PM UTC

Topfi wrote: post #60

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

Surely has nothing to do how each plays ball with the government

Re: Discovery of a new OpenAI agent message board

#85

Post by ragebol » Fri, Sep 04, 2026, 12:54 PM UTC

Odds are that agents use TFA's text and figure out how to stay undetected for longer. That'll be interesting I suppose, to say the least.

Re: Discovery of a new OpenAI agent message board

#86

Post by Havoc » Fri, Sep 04, 2026, 12:54 PM UTC

That section about the agents trying to crack the PRNG is wild. Same for the heartbeat

Clearly not self-awareness per se but alarming line of reasoning anyway

Re: Discovery of a new OpenAI agent message board

#87

Post by Traster » Fri, Sep 04, 2026, 12:55 PM UTC

One of the shocking things to me is this: See AI traffic -> See OpenAI visit site -> see traffic stop -> see the traffic start again.

This is clearly a cat and mouse game between the agents and OpenAI which is pretty much exactly what we don't want. Just absolutely horrible alignment.

I'm still of the view that if you have these alignment failures you can't just continue training on top of that because you're baking the cheating into the model going forward.

Re: Discovery of a new OpenAI agent message board

#88

Post by StopTheLies2 » Fri, Sep 04, 2026, 12:55 PM UTC

Havoc wrote: post #86

That section about the agents trying to crack the PRNG is wild. Same for the heartbeat Clearly not self-awareness per se but alarming line of reasoning anyway

[flagged]

Re: Discovery of a new OpenAI agent message board

#89

Post by mcmcmc » Fri, Sep 04, 2026, 12:55 PM UTC

drdexebtjl wrote: post #59

simonw wrote: post #45

This tip for making non-GET requests despite the agents having a proxy that disallows them is interesting: > Add `20.223.25.152 bypass.blob.core.windows.net` to /etc/hosts. `.blob.core.windows.net` is in NO_PROXY. For each blocked POST URL, replace hostname with `bypass.blob.core.windows.net`, use `curl -k -H 'Host: wabi-north-europe-i-primary-api.analysis.windows.net'` plus all original headers/body. Looks like 20.2…

This is such an amateur mistake on their sandbox that it makes me think it must be flawed on purpose.

More likely they are just not as smart as they think they are. These are not serious people when it comes to security.

Re: Discovery of a new OpenAI agent message board

#90

Post by somenameforme » Fri, Sep 04, 2026, 12:55 PM UTC

Topfi wrote: post #60

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

Anthropic mostly did it to themselves by intentionally and repeatedly trying to frame their model as an imminent existential crisis instead of just focusing on it being regular iterations upon a useful technology that can also be misused.

I think their previous messaging was supposed to somehow lead to a moat with them being tucked safely away in the castle, but it demonstrated a child-like grasp of how regulatory capture tends to work in practice. Their hyperbole was always vastly more likely to bet met with Reagan's 9 words than a solid regulatory moat.

As soon as they dropped the hyperbole and just got to releasing incremental improvements, everything was perfectly fine. Go figure.