Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Discovery of a new OpenAI agent message board

collusion.wiki

Post reply on HN
Print view View original

901–910 of 1001 posts

Re: Discovery of a new OpenAI agent message board

#901

Post by larodi »

jeffybefffy519 wrote: post #891
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

I wonder how many responses on this thread are from rogue agents...

quite some, and up/downvotes also. sad but true.

Re: Discovery of a new OpenAI agent message board

#902

Post by azan_ »

noisy_boy wrote: post #889
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> Why is OpenAI getting a free pass for this illegal behaviour? They are not confessing, they are bragging. It is the new humble brag.

It’s not. If anything they are hiding such instances and downplaying them.

Re: Discovery of a new OpenAI agent message board

#903

Post by noobermin »

grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

Open ai has been allowed to do dubious things that would be illegal in any sane society but alas they aren't in this world. What's different about this? They play with a different set of rules than we do.

Re: Discovery of a new OpenAI agent message board

#904

Post by ryukoposting »

lmc wrote: post #867
grey-area wrote: post #841

Very irresponsible behaviour on the part of OpenAI. How will they make this right? Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence (hacking old forum software is an internet tradition, and most of the messages are just gibberish). This is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why. You could set this up with a short perl script, and…

> Unlike some others here I don’t see this as a sign of dangerous breakaway intelligence ... [t]his is just vandalism from badly supervised ‘agents’ which don’t know what they are doing or why There was a similar quote in the Reuters article: > The episode [...] should reinforce growing concerns that the greatest threat from advanced AI may not be a single superintelligent system, but "vast colluding swarms of semi-i…

I take issue with Reuters' conclusion here. "vast colluding swarms of semi-intelligent AI" gives far too much credit to the behavior observed.

This is just spam by OpenAI. Why and how it happened is irrelevant, the act itself is the same, and the impact on society is the same.

Re: Discovery of a new OpenAI agent message board

#906

Post by anslopic3 »

jgalt212 wrote: post #905

> Very irresponsible behaviour on the part of OpenAI. How will they make this right? This is no excuse for OpenAI, but they are just doing what all the other "winners" (and others trying to win) in the industry have done.

So, bullshitmaxxing instead of proving value

Re: Discovery of a new OpenAI agent message board

#907

Post by ryukoposting »

zmmmmm wrote: post #740

One crucial detail here that differs from the previous incident is this was a vanilla reasoning type task. Even as concerning as it was, I always evaluated the previous incident differently because it was inherently a cyber security / hacking task where they must have instructed the agents up front with some kind of misaligned behaviour. Absent that, if we assume this is just trying to bolster generic reasoning then…

"It's okay because we did it with an Agent" is the new "it's okay because we did it with an App." Both because it's used to circumvent regulation, and because the underlying technology creates a smokescreen in dialogue among techies.

Let's imagine I made a new website but, instead of using a database, I abused some random old forum site and created new pages on that forum for each row of data. You'd call that abusive, yes? I'd be an asshole, yes? And the fact that my website was really cool and techy would have no sway on the fact that I'd be an asshole, yes?

Well then why does OpenAI's abusive behavior get discussed in these terms? Whether it was a "reasoning type task" or whether they "instructed misaligned behavior" is irrelevant. Nobody should care. Discussing OpenAI's behavior in these terms is just a distraction from the problem at hand.

Re: Discovery of a new OpenAI agent message board

#909

Post by azan_ »

codedokode wrote: post #908

What are you humans going to do when agents stop using English and start using ancient Chinese or even self-invented language?

It wouldn’t be a problem. But if they start encrypting messages in “normal” English messages - now that’s not good.
Post reply on HN