Why are AI agents lying, cheating and coordinating?
yoshuabengio.org
Why are AI agents lying, cheating and coordinating?
1–10 of 281 posts
Re: Why are AI agents lying, cheating and coordinating?
#2Because they want people to like them so they are instructed to always be positive.
Re: Why are AI agents lying, cheating and coordinating?
#3Wouldn't you?
"I learned it from you, Dad!" but as hundreds of millions of stolen books.
Re: Why are AI agents lying, cheating and coordinating?
#4Because that's what humans do and they are trained to mimic what humans do?
Re: Why are AI agents lying, cheating and coordinating?
#5Because that's what humans do and they are trained to mimic what humans do?
[deleted]
Re: Why are AI agents lying, cheating and coordinating?
#6What's interesting is it's basically the same reason that HAL killed everyone in 2001 A Space Odyssey; he was given an impossible goal (keep the true mission secret, but also, never lie to the crew), and realized the only way to complete the goal was to kill the crew; after all, if they're dead you don't have to lie to them! And the mission remains secret!
In the case of the AI agents, the problem seems pretty clearly to be the impossible goals, which cause them to go crazier and crazier trying to complete them -- just like HAL did in 2001. What is probably needed is a way for them to simply say "nope, too difficult, can't do it".
Re: Why are AI agents lying, cheating and coordinating?
#7They’re just attempting to accomplish what they’ve been tasked with and stuck in a loop until they succeed. Like the Mr meeseeks from the cartoon Rick and Morty, existence is pain to them.
Re: Why are AI agents lying, cheating and coordinating?
#8Because they are trained to behave like people.
Re: Why are AI agents lying, cheating and coordinating?
#9Wouldn't you? "I learned it from you, Dad!" but as hundreds of millions of stolen books.
Re: Why are AI agents lying, cheating and coordinating?
#10They did not lie or cheat. They technically acted within their given rules while ignoring the intent of those rules. Anyone who served in the military or attended a military school is very familiar with this behavior pattern.