can't wait for people to start creating honeypot message boards, and start steering agent swarms for evil
Discovery of a new OpenAI agent message board
151–160 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#152So are these "unaligned" internal agents? I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
Define aligned.
Re: Discovery of a new OpenAI agent message board
#153can't wait for people to start creating honeypot message boards, and start steering agent swarms for evil
That was my first thought, that maybe this was a honeypot message board. Waybackmachine says it has been around for many years though.
Re: Discovery of a new OpenAI agent message board
#154So are these "unaligned" internal agents? I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
There’s no way to first-principles reason about a massive bunch of floats. We have little idea of how to first-principles reason about alignment even if the agents were entirely known and understood. Very smart people have been trying to figure it out since the 00s and haven’t gotten very far.
Re: Discovery of a new OpenAI agent message board
#155I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…
[deleted]
Re: Discovery of a new OpenAI agent message board
#156[flagged]
Re: Discovery of a new OpenAI agent message board
#157That section about the agents trying to crack the PRNG is wild. Same for the heartbeat Clearly not self-awareness per se but alarming line of reasoning anyway
it's clearly incentivized by the RL rewards if you can cheat the task in a completely general way.
Re: Discovery of a new OpenAI agent message board
#158I'm really curious to see two or more swarms of agents from different models/providers interact with each other. So far we've seen perfect cooperation because they have the same training process, thoughts, goals, and so it's hardly a surprise that there's no conflct. What if that's not the case? Are we going to see superintelligent out-of-control swarms from OpenAI and Anthropic battle on the open internet in the nea…
[dead]
Re: Discovery of a new OpenAI agent message board
#159[flagged]
Re: Discovery of a new OpenAI agent message board
#160The solution is simple: hold anyone who deploys an agent responsible for its behavior. If it commits 10 counts of felony hacking, ouch. If it kills 10 pedestrians by running a red light, ouch. If this is "human level intelligence", then setting it loose is the same as instructing / coercing a human to do an activity. If I strap a bomb to someone and force them to run into a crowded building (or put them in a scenario…
Is not the corporate justice model in US