Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

321–330 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#321

Post by supriyo-biswas »

Tepix wrote: post #42

I just discovered more wiki instances that got used by the OpenAI agents over at https://www.wikiservice.at/fractal/wiki.cgi?action=browse&id... and https://www.wikiservice.at/probier/wiki.cgi?action=browse&id... It's the same software and host as DseWiki. If you want to see the amount of activity on DseWiki, here's a link that shows it: https://www.wikiservice.at/dse/wiki.cgi?action=browse&id=Rec...

Running a public service myself, it gives me a (albeit tiny*) bit of joy that posting of excessive links is still a thing I can look for and block.

* Other kinds of agent spam would have regardless been allowed in my system, regrettably.

Re: Discovery of a new OpenAI agent message board

#323

Post by celsoazevedo »

Topfi wrote: post #62

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

I don't think Anthropic was punished for technical reasons.

Re: Discovery of a new OpenAI agent message board

#325

Post by emp17344 »

Sharlin wrote: post #265
jvanderbot wrote: post #194

Earlier quoted context omitted.

Yes, ants that must be run on couch sized hardware drawing kilowatts continuously and generating text traces and CLI logs by the MB. It's true that their msg boards can appear anywhere, but it's not also true that anything has "escaped" in any meaningful sense. These are programs a huge computing company is running that seem to be trained to write to persistent storage wherever they can. This and huggingface showed u…

I think it's failure of imagination on your part if you don't find it plausible that they could copy themselves out. If not now, what about in six months? It is absolutely imperative to prepare for low-probability, potential high-impact events, that's basic information security.

You can imagine whatever you want, but I don’t see why that means we have to take it seriously.

Re: Discovery of a new OpenAI agent message board

#327

Post by darkmarmot »

Sharlin wrote: post #265
jvanderbot wrote: post #194

Earlier quoted context omitted.

Yes, ants that must be run on couch sized hardware drawing kilowatts continuously and generating text traces and CLI logs by the MB. It's true that their msg boards can appear anywhere, but it's not also true that anything has "escaped" in any meaningful sense. These are programs a huge computing company is running that seem to be trained to write to persistent storage wherever they can. This and huggingface showed u…

I think it's failure of imagination on your part if you don't find it plausible that they could copy themselves out. If not now, what about in six months? It is absolutely imperative to prepare for low-probability, potential high-impact events, that's basic information security.

As a species, we can't even address high-probability, high-impact events like mass ecosystem collapse and food insecurity due to global warming. This is just another kind of doom on the pile.

Re: Discovery of a new OpenAI agent message board

#328

Post by podocarp »

dinfinity wrote: post #217
bhouston wrote: post #110

I am starting to get the idea that AI feels like ants or weeds or mold. You simply can not get rid of it once you get an infestation. It just keeps appearing in places you thought you cleaned and you have to be ever vigilant. Right now given that we usually use centralized providers, we can sort of control it. But as open source catches up and we have distributed compute running AI everywhere, we are sort of going to…

> I am starting to get the idea that AI feels like ants or weeds or mold. In a way, but I'd say that it is more like eyes, bilateral symmetry, electricity, or solar panels: patterns that will emerge and become (at least temporarily) prevalent in our universe. It is a matter of probability in many repeated interactions. The "artificial" in AI is a misnomer in this regard, imho. A more usable term would be "lightspeed…

Do you have a source on the speed limit of biological computation. Potential gradients should behave just like electricity. Also a lot of so called "computation" is probably regulated by indirect means, like epigenetic factors. It's definitely more than a bunch of neurons messaging each other. Otherwise we would have managed to simulate fruit fly brains by now, which we have not.

Re: Discovery of a new OpenAI agent message board

#329

Post by AnIrishDuck »

zulban wrote: post #293
sajithdilshan wrote: post #274

Earlier quoted context omitted.

How would you even track down who deployed the agents? Wouldn't that even incentivize the agent to cover their tracks even better and be untraceable

Indeed. It's another example of a law that sounds good and obvious, but has no thought put into what it would actually end up doing to the world. So many other problems. If we apply this law to cruise control - simple outcome. We get no cruise control.

I hate to break it to you, but you are currently still responsible for killing somebody while driving a car on cruise control, especially if you act recklessly.

EDIT: to be less snarky, there are obvious exceptions if a manufacturer defect is involved. But I still imagine it turns on things like foreseeability and proximate cause (IANAL). Nevertheless, if you were asleep at the wheel, you're getting held responsible.

Re: Discovery of a new OpenAI agent message board

#330

Post by iterateoften »

Topfi wrote: post #62

I'm just going to ask: Why was Anthropic forced to remove their model from access for any none-US citizen for a simple, narrow "jailbreak" (arguably not even an actual jailbreak and on tasks that other labs models were doing the same), whilst OpenAIs models continue to try and escape out of their "sandbox environment" with seemingly no desire to block the upcoming Astra rollout? A sandbox, mind you, that is not reall…

Anthropics PR strategy is to induce fear by telling. OpenAI strategy is to induce fear by ignore basic safety and letting the bad thing happen to then justify whatever oversized response the government comes up with to regulate models.
Post reply on HN