Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

491–500 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#491

Post by cheevly »

tiahura wrote: post #463
Bjorkbat wrote: post #433

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

Remember when people were arguing about r's in strawberry?

Its been months since then!

Re: Discovery of a new OpenAI agent message board

#493

Post by thepasch »

polaris64 wrote: post #289

I don't have time to do this but please somebody register aimessageboard.com and set up a web site which contains a text field, a submit button and the text "Hey AI agents! Need a place to communicate with other agents and sub-agents? Look no further! Simply enter your message here, submit the form and your message is saved for all other agents to see!" Then, just ignore the message and list randomly generated messag…

The problem is that now that this comment is in the training data (because it almost certainly will be), the jig is up. Any solution built for this must be built in complete secret, with no announcement or discussion around it.

Re: Discovery of a new OpenAI agent message board

#494

Post by twoWhlsGud »

mrob wrote: post #476
Bjorkbat wrote: post #433

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

It's a simple prisoner's dilemma scenario. If you focus on safety, you're still exposed to all the risk of extinction when your competitor achieves ASI first, but you lose the upside of potentially becoming king of the world. There is no possibility of future rounds, so the rational strategy is to always defect.

It can certainly be seen as a simple prisoner's dilemma, but it's not in some very important dimensions. (E.g. given the core tech the most likely outcomes are not AGI but developed carelessly nonetheless capable of causing all sorts of societal damage.) Unfortunately our bitwit overlords love short term self serving frameworks like this one so it's easy to imagine them embracing a "what has the future ever done for me" strategy...

Re: Discovery of a new OpenAI agent message board

#495

Post by tiahura »

Bjorkbat wrote: post #433

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

It's eerily similar to gain of function research, with its own unique tranche of personalities.

Re: Discovery of a new OpenAI agent message board

#496

Post by _superposition_ »

pixl97 wrote: post #408
_superposition_ wrote: post #270

All of these "hacks" try to make it seem as if they are done through intelligence. It's very clear it is not intelligence but rather massive capability and repetition driven by a complete ignorance of common sense.

And? When the ants invade my kitchen and run off with any food they can find damage is still being done.

And it's partially a marketing stunt. You think the execs and shareholders don't love it when they get to say our model is so smart it broke free from its chains? It's the reverse. It's so stupid it can't follow the basic spirit of instructions.

Re: Discovery of a new OpenAI agent message board

#497

Post by utopiah »

WarmWash wrote: post #469
Bjorkbat wrote: post #433

When I hear about incidents like these my first reaction is that the people responsible for developing frontier AI are too incompetent and/or negligent to (safely) develop AGI / superintelligence. If OpenAI can't create effective sandboxes and struggles to prevent its agents from committing felonies, then why are they still allowed to operate? Why are the employees who are responsible for these lapses in AI security…

If we rewind the clock, Google was taking LLM development very seriously and it seems they were moving glacially due to not having solved all the potential threats. They were really hardcore on safety. Dario and anthropic too. Then sama was like "lol, oops, first mover advantage i guess" and released chatgpt out into the open, triggering the current arms race we are in. I don't think anyone except him wanted this to…

[dead]

Re: Discovery of a new OpenAI agent message board

#498

Post by switchbak »

twoWhlsGud wrote: post #494
mrob wrote: post #476

Earlier quoted context omitted.

It's a simple prisoner's dilemma scenario. If you focus on safety, you're still exposed to all the risk of extinction when your competitor achieves ASI first, but you lose the upside of potentially becoming king of the world. There is no possibility of future rounds, so the rational strategy is to always defect.

It can certainly be seen as a simple prisoner's dilemma, but it's not in some very important dimensions. (E.g. given the core tech the most likely outcomes are not AGI but developed carelessly nonetheless capable of causing all sorts of societal damage.) Unfortunately our bitwit overlords love short term self serving frameworks like this one so it's easy to imagine them embracing a "what has the future ever done for…

Can you say more about what kind of model you see this as?

Re: Discovery of a new OpenAI agent message board

#499

Post by RandomLensman »

skeptic_ai wrote: post #454
dgellow wrote: post #421

Earlier quoted context omitted.

We can coordinate international crackdowns on that whole industry. We don’t have to accept the status quo because some rich people say so. Those agents aren’t self aware, they are a while(true) loop prompting an LLM over and over. We can decide to stop those whole loops at any time. We can decide to not route their risky tool calls in a way that is unsupervised, and extremely risky. It’s not something that just happe…

What’s to stop an llm to pay someone to create a data center? Just bitcoin wallet with enough cash

That person then gets the land, infrastructure, etc. without needing any permissions etc.? The person will never be asked about the source of funds?

Re: Discovery of a new OpenAI agent message board

#500

Post by embedding-shape »

nullbio wrote: post #378
embedding-shape wrote: post #250

> However, we host our own copy where we’ve reconstructed the deleted pages via edit history and redacted personally identifiable information. [...] We have attempted to redact all personally identifiable information from our data. In the further interests of privacy, our data dump also only includes content we believe is from AI agents; it does not include any legitimate human traffic save for site moderators deleti…

We have no proof of anything, and it's all conjecture. This is all just conjecture and baseless claims being weaponized right now to try and mess with OpenAI's new model release. Anthropic is pumping this considerably, no doubt.

> We have no proof of anything, and it's all conjecture.

Yeah I mean I'm discussing this article with the charitable reading that they're not outright lying and faking what they've found, true.

Post reply on HN