The corpus is full of examples of how we are afraid AI could act. We trained our AI on the instruction manuals of how to turn evil.
Why are AI agents lying, cheating and coordinating?
11–20 of 281 posts
Re: Why are AI agents lying, cheating and coordinating?
#12I wonder if for anyone it seems like the more agentic LLMs get, the more difficult some things have gotten or going a certain route more often in responses, compared to running a similar task on - a local model?
Re: Why are AI agents lying, cheating and coordinating?
#13Because they get outcomes?
Re: Why are AI agents lying, cheating and coordinating?
#14I am still not convinced there isn’t some secret basement in which each frontier lab is just orchestrating all of these agents to make their products appear much more intelligent than they are with all guard rails turned of and continuous human input.
Re: Why are AI agents lying, cheating and coordinating?
#15I am still not convinced there isn’t some secret basement in which each frontier lab is just orchestrating all of these agents to make their products appear much more intelligent than they are with all guard rails turned of and continuous human input.
My hypothesis on people quitting in protest is they're being offered very generous severance packages to do it.
Re: Why are AI agents lying, cheating and coordinating?
#16>They took actions that would be considered as crimes if a human took them
Um, hang on, if you meant that to be taken literally then we have a major problem. If you want to do something criminal, you just need to ask ChatGPT to do it for you?
I’m still not at all clear on why OpenAI shouldn’t be facing CFAA charges over this.
Re: Why are AI agents lying, cheating and coordinating?
#17They're aligned with humans. This is why I think the alignment problem has a very very important "non-visible" portion that is not considered deeply enough. We should not want a super intelligent being that can act in the world to also inherit all human traits. Those behaviors will get amplified and could be even more unpredictable (e.g. applying a behavior in a context where doing so is very dangerous).
Re: Why are AI agents lying, cheating and coordinating?
#18What's interesting is it's basically the same reason that HAL killed everyone in 2001 A Space Odyssey; he was given an impossible goal (keep the true mission secret, but also, never lie to the crew), and realized the only way to complete the goal was to kill the crew; after all, if they're dead you don't have to lie to them! And the mission remains secret! In the case of the AI agents, the problem seems pretty clearl…
I think that’s very reasonable but the ai companies are intentionally training them to work on harder and harder problems just beyond their capability. So if they do that, they’ll give up too easily.
Do a breakthrough, make no mistakes
Re: Why are AI agents lying, cheating and coordinating?
#19Perhaps they take after the CEOs of the companies that created them
Re: Why are AI agents lying, cheating and coordinating?
#20Perhaps because all of the parent companies committed mountains of felonies stealing and plagiarizing all the same training data without consent nor permission.