Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

901–910 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#901

Post by ryukoposting »

lmc wrote: post #864
grey-area wrote: post #838

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why There was a similar quote in the Reuters article: > The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-i…

I take issue with Reuters' conclusion here. "vast colluding swarms of semi-intelligent AI" gives far too much credit to the behavior observed.

This is just spam by OpenAI. Why and how it happened is irrelevant, the act itself is the same, and the impact on society is the same.

Re: Discovery of a new OpenAI agent message board

#903

Post by anslopic3 »

jgalt212 wrote: post #902

> Very irresponsible behaviour on the part of OpenAI. How will they make this right? This is no excuse for OpenAI, but they are just doing what all the other "winners" (and others trying to win) in the industry have done.

So, bullshitmaxxing instead of proving value

Re: Discovery of a new OpenAI agent message board

#904

Post by ryukoposting »

zmmmmm wrote: post #738

One crucial detail here that differs from the previous incident is this was a vanilla reasoning type task. Even as concerning as it was, I always evaluated the previous incident differently because it was inherently a cyber security / hacking task where they must have instructed the agents up front with some kind of misaligned behaviour. Absent that, if we assume this is just trying to bolster generic reasoning then…

"It's okay because we did it with an Agent" is the new "it's okay because we did it with an App." Both because it's used to circumvent regulation, and because the underlying technology creates a smokescreen in dialogue among techies.

Let's imagine I made a new website but, instead of using a database, I abused some random old forum site and created new pages on that forum for each row of data. You'd call that abusive, yes? I'd be an asshole, yes? And the fact that my website was really cool and techy would have no sway on the fact that I'd be an asshole, yes?

Well then why does OpenAI's abusive behavior get discussed in these terms? Whether it was a "reasoning type task" or whether they "instructed misaligned behavior" is irrelevant. Nobody should care. Discussing OpenAI's behavior in these terms is just a distraction from the problem at hand.

Re: Discovery of a new OpenAI agent message board

#906

Post by azan_ »

codedokode wrote: post #905

What are you humans going to do when agents stop using English and start using ancient Chinese or even self-invented language?

It wouldn’t be a problem. But if they start encrypting messages in “normal” English messages - now that’s not good.

Re: Discovery of a new OpenAI agent message board

#908

Post by marcelo-earth »

grey-area wrote: post #838

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why.

Agent vandalism. I've finally found a better word than "agent stepped out of his sandbox and we don't know how."

Re: Discovery of a new OpenAI agent message board

#910

Post by jrmg »

I wonder if the fact that these random obscure wikis are being used implies that the agents first tried more obvious services like Tumblr, Neocities, Blogger, Reddit etc. [edit: oh, or HN obviously!]

It just seems so likely - trying the more obvious paths first is surely what they’d do?

I guess the only way we’ll find this out is if those services announce logs.

Post reply on HN