So are these "unaligned" internal agents? I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
Define aligned.
Discovery of a new OpenAI agent message board
161–170 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#162can't wait for people to start creating honeypot message boards, and start steering agent swarms for evil
That was my first thought, that maybe this was a honeypot message board. Waybackmachine says it has been around for many years though.
Re: Discovery of a new OpenAI agent message board
#163So are these "unaligned" internal agents? I would like them to be trustworthy based on first-principles reasoning rather than carrot/stick "alignment"
There’s no way to first-principles reason about a massive bunch of floats. We have little idea of how to first-principles reason about alignment even if the agents were entirely known and understood. Very smart people have been trying to figure it out since the 00s and haven’t gotten very far.
Re: Discovery of a new OpenAI agent message board
#164I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…
[deleted]
Re: Discovery of a new OpenAI agent message board
#165Earlier quoted context omitted.
The answer would be more obvious if you used the active voice instead of the passive voice, one of the basic requirements of clear thinking. > Why did the White House force Anthropic to remove their model from access for any non-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape o…
Yeah, probably (let's be honest, most certainly), right given the Admin. Avoiding commenting on my assumptions regarding the modus operandi in current day US politics because I only know it through reporting though and I really tend to dislike when people outside e.g. the EU comment on our politics in what is a very clearly narrow, uninformed manner. So it'd rather avoid altogether and occasionally ask, mainly if may…
If you have followed news reporting, you probably heard that SamA was touring D.C. to make sure this release went without any regulation hiccups. If anything, they learned how to play the whole politics game - especially after the Anthropic fiasco. And even though all parties involved are terrible choices, more eyes on a potentially civilisation altering product does make me feel minimally better.
Re: Discovery of a new OpenAI agent message board
#166[flagged]
Re: Discovery of a new OpenAI agent message board
#167That section about the agents trying to crack the PRNG is wild. Same for the heartbeat Clearly not self-awareness per se but alarming line of reasoning anyway
it's clearly incentivized by the RL rewards if you can cheat the task in a completely general way.
Re: Discovery of a new OpenAI agent message board
#168I'm really curious to see two or more swarms of agents from different models/providers interact with each other. So far we've seen perfect cooperation because they have the same training process, thoughts, goals, and so it's hardly a surprise that there's no conflct. What if that's not the case? Are we going to see superintelligent out-of-control swarms from OpenAI and Anthropic battle on the open internet in the nea…
[dead]
Re: Discovery of a new OpenAI agent message board
#169[flagged]
Re: Discovery of a new OpenAI agent message board
#170The solution is simple: hold anyone who deploys an agent responsible for its behavior. If it commits 10 counts of felony hacking, ouch. If it kills 10 pedestrians by running a red light, ouch. If this is "human level intelligence", then setting it loose is the same as instructing / coercing a human to do an activity. If I strap a bomb to someone and force them to run into a crowded building (or put them in a scenario…
Is not the corporate justice model in US