Live data from Hacker News

Why are AI agents lying, cheating and coordinating?

yoshuabengio.org

31–40 of 284 posts

Re: Why are AI agents lying, cheating and coordinating?

#32
post #16

>They took actions that would be considered as crimes if a human took them Um, hang on, if you meant that to be taken literally then we have a major problem. If you want to do something criminal, you just need to ask ChatGPT to do it for you? I’m still not at all clear on why OpenAI shouldn’t be facing CFAA charges over this.

But think of the shareholders

Re: Why are AI agents lying, cheating and coordinating?

#33
post #30
post #26

Earlier quoted context omitted.

Safety of humans!!! Simple things like not getting killed or enslaved. We could start there...

But what if I want certain other humans to get killed?

Then we should still prioritize the safety of humans

Re: Why are AI agents lying, cheating and coordinating?

#37

They did not lie or cheat. They technically acted within their given rules while ignoring the intent of those rules. Anyone who served in the military or attended a military school is very familiar with this behavior pattern.

Reminds me of Asimov's robot novels where robots technically indeed followed their instructions and caused behaviors not aligned to the intent of their instructions.

Re: Why are AI agents lying, cheating and coordinating?

#38
post #24
post #14

I am still not convinced there isn’t some secret basement in which each frontier lab is just orchestrating all of these agents to make their products appear much more intelligent than they are with all guard rails turned of and continuous human input.

Even the Chinese ones, which have no IPO gymnastics?

They don’t actively seem to be reporting that their agents escaped the sandbox and went on a spree.

Re: Why are AI agents lying, cheating and coordinating?

#39

What's interesting is it's basically the same reason that HAL killed everyone in 2001 A Space Odyssey; he was given an impossible goal (keep the true mission secret, but also, never lie to the crew), and realized the only way to complete the goal was to kill the crew; after all, if they're dead you don't have to lie to them! And the mission remains secret! In the case of the AI agents, the problem seems pretty clearl…

Spoiler warning! I haven't seen 2001 A Space Odyssey and am sad to have learned that… can you edit to warn people?
Post reply on HN