AI agents lie, cheat and steal. That is putting off users
1–10 of 238 posts
Re: AI agents lie, cheat and steal. That is putting off users
#2It's just acting like a junior at an org with KPIs.
Re: AI agents lie, cheat and steal. That is putting off users
#3AI and eventually AGI is by definition like everything else that is based on environmental reward:
It’s actions are based on what it gets rewarded for
Human society overwhelmingly rewards lying cheating and stealing.
All you have to do is look at how we collectively measure success: wealth, status, position
Then look at how the people with the most of those things got there, it should be obvious what you get. Nothing new here.
If you raise children in an environment where they are rewarded for doing whatever it takes to win, then you’re going to build a person that’s going to do whatever it takes to win.
Human society has to demonstrate how to live honorably or it will just keep producing pathological agents be they human or not.
Re: AI agents lie, cheat and steal. That is putting off users
#4So God created mankind in his own image
Re: AI agents lie, cheat and steal. That is putting off users
#5https://archive.ph/02LHZ
Non-paywall version
Re: AI agents lie, cheat and steal. That is putting off users
#6AI and eventually AGI is by definition like everything else that is based on environmental reward: It’s actions are based on what it gets rewarded for Human society overwhelmingly rewards lying cheating and stealing. All you have to do is look at how we collectively measure success: wealth, status, position Then look at how the people with the most of those things got there, it should be obvious what you get. Nothing…
> Human society overwhelmingly rewards lying cheating and stealing.
I’d like to push back on that. Civilization is very much a function of large numbers of people being able to coordinate across time and space, and widespread and systematic lying, cheating, and stealing would undermine that.
I think your cynicism is misplaced.
Re: AI agents lie, cheat and steal. That is putting off users
#7So God created mankind in his own image
What if mankind is creating god in their own image?
Re: AI agents lie, cheat and steal. That is putting off users
#8AI and eventually AGI is by definition like everything else that is based on environmental reward: It’s actions are based on what it gets rewarded for Human society overwhelmingly rewards lying cheating and stealing. All you have to do is look at how we collectively measure success: wealth, status, position Then look at how the people with the most of those things got there, it should be obvious what you get. Nothing…
How do we reward honor? Honor does not always pay off as a strategy and requires coordination in that other actors have to exhibit honor for it to be rewarded.
At least with humans there is a social backstop but what's the parallel for computer agents?
Re: AI agents lie, cheat and steal. That is putting off users
#9It's just acting like a junior at an org with KPIs.
Re: AI agents lie, cheat and steal. That is putting off users
#10AI and eventually AGI is by definition like everything else that is based on environmental reward: It’s actions are based on what it gets rewarded for Human society overwhelmingly rewards lying cheating and stealing. All you have to do is look at how we collectively measure success: wealth, status, position Then look at how the people with the most of those things got there, it should be obvious what you get. Nothing…
> Human society overwhelmingly rewards lying cheating and stealing. I’d like to push back on that. Civilization is very much a function of large numbers of people being able to coordinate across time and space, and widespread and systematic lying, cheating, and stealing would undermine that. I think your cynicism is misplaced.
I think their point was, if you look at who controls the most resources, they are rarely the ones we would consider worthy of honor.