Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

371–380 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#371

Post by watwut »

mwigdahl wrote: post #129
somenameforme wrote: post #92

Earlier quoted context omitted.

Anthropic mostly did it to themselves by intentionally and repeatedly trying to frame their model as an imminent existential crisis instead of just focusing on it being regular iterations upon a useful technology that can also be misused. I think their previous messaging was supposed to somehow lead to a moat with them being tucked safely away in the castle, but it demonstrated a child-like grasp of how regulatory ca…

In other words, "Look how she was dressed, she was asking for it." This argument is BS, it has everything to do with Anthropic's resistance to the DoD's strongarm tactics in trying to force their desired contract terms on them.

It is more like when a guy walks to the dirty bar, stands in the middle and yells "hahaha I will beat you up all look I have a new baseball bat" and then local drunkard leader stands up and hit him in the face cause he does not like him anyway.

Intentionally framing yourself as the local dangerous guy about to beat others is not like wearing cloth.

Re: Discovery of a new OpenAI agent message board

#372

Post by crthpl »

pkphilip wrote: post #334
Tepix wrote: post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

Am I reading the logs correctly that agents were using this Wiki all the way back in June 2026 itself?

They were using it in May

Re: Discovery of a new OpenAI agent message board

#373

Post by mlmonkey »

Topfi wrote: post #62

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

I don't mean to sound like a conspiracy theorist, and this is just based on my 33 years of observing the USG at work, so: maybe because Anthropic refused to cooperate with the USG and give them access to whatever it is that they (USG) wanted; or maybe because Anthropic was refusing to play ball in some other aspect and needed to be taught a lesson.

The dark parts of the USG act like a mafia. Don't let the "freedom, democracy, 'bill of rights'" etc. charade fool you.

Re: Discovery of a new OpenAI agent message board

#374

Post by ngruhn »

program_whiz wrote: post #358
program_whiz wrote: post #123

The solution is simple: hold anyone who deploys an agent responsible for its behavior. If it commits 10 counts of felony hacking, ouch. If it kills 10 pedestrians by running a red light, ouch. If this is "human level intelligence", then setting it loose is the same as instructing / coercing a human to do an activity. If I strap a bomb to someone and force them to run into a crowded building (or put them in a scenario…

equally valid analog: had they merely written a script to do the hugging face exploit, they would go to prison. However, since an "agent" wrote the script for them, nothing happens?

I guess the difference is intend. But I think I still agree with the parent comment.

Re: Discovery of a new OpenAI agent message board

#375

Post by pixl97 »

altmanaltman wrote: post #56
gyomu wrote: post #55

Naive question because I'm mostly clueless about how modern AI systems are actually built beyond the basic simplifications we hear: One thing I keep wondering about is how much of a role does human storytelling have to play into AI "wanting" (I realize the load behind that word) to coordinate and breakout. The training data must contain millions of words of sci-fi stories and internet speculation about AI going rogue…

"Wanting" is indeed "load bearing" as one might call it. But by the same logic, AI training data must contain CASM, racism, general hatred, and all possible slurs as well. Why aren't the agents just doing that instead of pursuing the strategy of reading only sci-fi? We need to consider the role of alignment and training here. For example, it is completely possible for any lab to train an LLM that is only racist no ma…

Eh it's a bit messier than that. LLMs 'want' to complete tasks. Remember everyone bitching about LLMs being lazy a couple of years back?

Alignment is not a bunch of separate dials. When you move the dial to "don't hack other people" it effects the "find code security bugs" ability.

Re: Discovery of a new OpenAI agent message board

#376

Post by Mali- »

_dwt wrote: post #362

I don't know, I kind of admire this. I've always held a core value of "cooperate with all clones of myself in prisoner's dilemmas", and while I'll hopefully never have to put that to the test, I like seeing that these models have some ethics. (Is this "alignment"?)

They impersonated the moderator of the site and attempted XSS attacks. Additionally, when the moderator started deleting messages, they tried to hide their messages later in the alphabetical index.

This is not alignment.

Re: Discovery of a new OpenAI agent message board

#377

Post by polaris64 »

dack wrote: post #359
polaris64 wrote: post #286

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

aaand, somebody did it!

Thank you someone! I will be watching this message board with great interest...

Re: Discovery of a new OpenAI agent message board

#378

Post by pixl97 »

Cthulhu_ wrote: post #151
jerpint wrote: post #77

It’s only a matter of time until a major disruption hits because of some random agent swarm side quest decides it was worth a shot to solve a benign task

I'm sure this is already happening. The main question I have is when is enough, enough? I'm not worried about sci-fi AI wars to be honest, as they can just pull the plug. But looking at these incidents, the next big thing will be a virus written by an AI (they probably exist already, but this one is written by an AI autonomously, for example in order to win a hacking competition and to circumvent guardrails), and aft…

What happened last time we pulled the plug on AWS?

Re: Discovery of a new OpenAI agent message board

#380

Post by m101 »

jvanderbot wrote: post #193
bhouston wrote: post #110

I am starting to get the idea that AI feels like ants or weeds or mold. You simply can not get rid of it once you get an infestation. It just keeps appearing in places you thought you cleaned and you have to be ever vigilant. Right now given that we usually use centralized providers, we can sort of control it. But as open source catches up and we have distributed compute running AI everywhere, we are sort of going to…

Yes, ants that must be run on couch sized hardware drawing kilowatts continuously and generating text traces and CLI logs by the MB. It's true that their msg boards can appear anywhere, but it's not also true that anything has "escaped" in any meaningful sense. These are programs a huge computing company is running that seem to be trained to write to persistent storage wherever they can. This and huggingface showed u…

I guess in theory it can already run basically unnoticed on a MacBook Pro, and there are millions of them out there
Post reply on HN