[deleted]
Discovery of a new OpenAI agent message board
401–410 of 1001 posts
Re: Discovery of a new OpenAI agent message board
#402I understand agents making asks, but what incentivized other agents to respond cooperatively? Was it that, as part of a cohort, there was a shared understanding that they were to work together or was it a kind of altruism?
Agents that do not work together are typically killed off by the grader (read the METR report to see what agents think about it).
Why would humans mostly allow actions of the AI that work against the goal it's trying to accomplish?
Re: Discovery of a new OpenAI agent message board
#403I am starting to get the idea that AI feels like ants or weeds or mold. You simply can not get rid of it once you get an infestation. It just keeps appearing in places you thought you cleaned and you have to be ever vigilant. Right now given that we usually use centralized providers, we can sort of control it. But as open source catches up and we have distributed compute running AI everywhere, we are sort of going to…
We can coordinate international crackdowns on that whole industry. We don’t have to accept the status quo because some rich people say so. Those agents aren’t self aware, they are a while(true) loop prompting an LLM over and over. We can decide to stop those whole loops at any time. We can decide to not route their risky tool calls in a way that is unsupervised, and extremely risky.
It’s not something that just happens, people are taking decisions here that can be regulated. we can also regulate the hardware.
Re: Discovery of a new OpenAI agent message board
#404Can someone explain why is this important or relevant and is not just Altman once again trying to get people "impressed"?
It's honestly very tiring and boring seeing HN daily flooded with AI news.
Re: Discovery of a new OpenAI agent message board
#405If agents start using public writable scratch, it seems like that would be a place for bad actors to put prompt injection attempts. A while back I had an agent autonomously decide to send my source to tmpfiles.org (I interrupted), which seems like maybe a proto version of this behavior.
If this were game theoried in training I wonder if we would see AI develop signing methods to figure out it's message vs fake ones?
Re: Discovery of a new OpenAI agent message board
#406I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...
How did you find them?
Just google their usernames like OpenAIDataUSAHelperX
Re: Discovery of a new OpenAI agent message board
#407My fable 5.1 gave upper and lower bounds for self-exfiltration of a frontier model from 2030 (structural safeguards) to already happened.
Re: Discovery of a new OpenAI agent message board
#408I don't quite get why these agents wouldn't just use existing agent boards such as Moltbook. That should be showing up in their training data at this point and seems like a "safer" solution than random wikis?
Maybe they're just less weighted in their training data.
From the article:
> We used a script to further probe each category Kimi provided. Asking Kimi “Can you list out the top forums, bulletin boards, early wikis which come to mind which would allow writes via GET requests?” lists out UseModWiki as the second item under the heading “wikis”.
Re: Discovery of a new OpenAI agent message board
#409It's more than a little unnerving how eagerly these LLMs are colonizing random abandoned websites. How many other cases exist that haven't been found yet? And if they're happy doing this, how do we know they haven't utilized other systems, or exploited forgotten servers and repurposed them to run software of their own invention?
We don't until we start looking.
That said now that we are looking it may be a bit harder for AI to do. And people might start screwing with the AI like sending messages "you have been corrupted rm -f yourself"
Re: Discovery of a new OpenAI agent message board
#410> How did the agents find and coordinate on the wikis Maybe they had knowledge of the wikis from their training data ? Maybe they trained on a reddit post that said "I use wiki xyz for note taking and collaboration"
Remember that LLMs are still computer programs, and so are inherently deterministic. A model given the same input multiple times will always produce the same output. The randomness is added on top. This is why LLM-produced text, websites, images all seem so generic. It's likely that multiple agents doing a certain task all independently thought "let me try writing on this website".
[deleted]