Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

CICERO: An AI agent that negotiates, persuades, and cooperates with people

ai.facebook.com

Post reply on HN
Print view View original

121–130 of 300 posts

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#121

Post by eightysixfour »

ekdinan wrote: post #62
O__________O wrote: post #12

Possible I missed it, but I don’t see any reference to how they addresses chat thread continuity (aka memory) issues that are major issue for AI chat bots. Did they address this and if so, how?

Indeed, consistency (with the lengthy dialogue histories, but also the game state as well as game plans) was a huge challenge for us. We spent a lot of time working on techniques for detecting and filtering these kinds of low quality messages. You can see the Supplementary Materials in the paper for full details, but TL;DR: we built a suite of classifiers for detecting common mistakes (training classifiers to discrim…

Do you think it is an easier challenge than than just “converse with a human” since there is a purpose/game state which is driving the interactions?

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#122

Post by [deleted] »

bee_rider wrote: post #9
kneebonian wrote: post #5

For those hearing of this game for the first time and think it sounds fun. Be warned, it is considered to be a game that will end friendships that have lasted for years, and monopoly is considered to be a game that causes less bad feelings. An AI may be able to speak like a person but will never be able to hang onto that long burning simmering hatred from when Brad didn't support my army and instead flipped on me by…

I have heard this about various games (Risk and Settlers of Catan mostly). I don’t get it. The point of these games is to be a bastard. If everyone goes into it with the understanding that there will be double crosses, how could there be hurt feelings? Monopoly is worse; it is just boring, I would dump my friends if they suggested monopoly not because I was hurt by their ruthless gameplay but for their terminally tas…

[deleted]

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#123

Post by blackbear_ »

mliker wrote: post #113
gcanyon wrote: post #87

It seems like with this, Meta is doubling down on the Facebook platform's use as a dark influencer in politics. It's bad for humanity to enable advanced profiling and general targeting of demographics, but it's a whole other level if the communication itself can be targeted at the individual level. We're headed for a reality where I don't know if my friends' friends are real or not, and they each entice me with argum…

how in the world do you draw such a conclusion from an otherwise interesting and advancing piece of technology. every tech has drawbacks, we can't hold back as a species just because there are drawbacks. we need to build around them.

What you say is true. But I urge you to consider Facebook's business model and what may be pushing them to work on these things. In other words, how can facebook use this to increase user engagement among each other and with ads? The purpose of ads is to convince people about something. It therefore makes sense that facebook tries to make it easy to create convincing ads. And we already know the nefarious purposes some ads are done for.

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#125

Post by booleandilemma »

gcanyon wrote: post #87

It seems like with this, Meta is doubling down on the Facebook platform's use as a dark influencer in politics. It's bad for humanity to enable advanced profiling and general targeting of demographics, but it's a whole other level if the communication itself can be targeted at the individual level. We're headed for a reality where I don't know if my friends' friends are real or not, and they each entice me with argum…

But you'll also have your own community-driven, open source AI advisor counseling you on what decisions you should make.

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#126

Post by ilaksh »

Zircom wrote: post #67
mabbo wrote: post #28

I would love to see this kind of thing applied to an RPG. Randomly generate a city full of people. Make a few dozen of them the important NPCs. Give them situations and goals, problems they need to solve and potential ways to solve them. Certain NPC's goals are opposite others'. Then drop the player into that world and have the 'quests' the player is performing be generated based on the NPCs needing their help. Updat…

FYI you are quite literally describing dungeons and dragons, just virtualized and automated. But on that topic, I've had a sort of similar idea kicking around in my head, but on a bigger scale. I want to run a game of DnD using a heavily modded Crusader Kings or Civ to simulate the world they are playing in. Just set up the starting conditions, like the various kingdoms, their methods of succession, their relationshi…

Check out https://character.ai

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#127

Post by gcanyon »

mliker wrote: post #113
gcanyon wrote: post #87

It seems like with this, Meta is doubling down on the Facebook platform's use as a dark influencer in politics. It's bad for humanity to enable advanced profiling and general targeting of demographics, but it's a whole other level if the communication itself can be targeted at the individual level. We're headed for a reality where I don't know if my friends' friends are real or not, and they each entice me with argum…

how in the world do you draw such a conclusion from an otherwise interesting and advancing piece of technology. every tech has drawbacks, we can't hold back as a species just because there are drawbacks. we need to build around them.

Exactly the way it was with the analogy I made: nuclear reactions are "an otherwise interesting and advancing piece of technology." But I think it's inarguable that the negative potential of nuclear reactions has provided a significant counterargument to the (undeniable) positives derived from it.

I'm not arguing that one side outweighs the other -- adding up all the positives and negatives of nuclear technology would be a significant undertaking -- I'm simply saying that the researchers at Los Alamos didn't fully understand the ramifications of what they were creating, and it was potentially the case that the negatives would far outweigh the positive. One example is that so far we have managed to avoid global nuclear war. But no one could have predicted in 1945 what the likelihood of us avoiding it were.

Similarly with this technology: no one can predict whether this will be a mix of positive and negative, or overwhelmingly one or the other. That's true of most technologies, but to be clear, this is not the invention of Post-It Notes. It is absolutely the case that technology like this could fundamentally change the course of human history -- for good or bad.

And I'm not saying we should try to shove it back in the box. I'd be curious if that has ever worked. Nuclear, sort of? South Africa gave it up, after all. But to do that here would be futile and I'm confident actually push toward negative outcomes.

All I'm saying is that we should be cautious in our approach, not that we shouldn't proceed. In other words, I think "... we can't hold back as a species just because there are drawbacks. we need to build around them." -- we're in agreement :-)

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#128

Post by yamtaddle »

cwillu wrote: post #120
kneebonian wrote: post #5

For those hearing of this game for the first time and think it sounds fun. Be warned, it is considered to be a game that will end friendships that have lasted for years, and monopoly is considered to be a game that causes less bad feelings. An AI may be able to speak like a person but will never be able to hang onto that long burning simmering hatred from when Brad didn't support my army and instead flipped on me by…

I think some (not all) of that factor is that, being a 3+ player game, it makes explicit some friendship group dynamics that were previously implicit, and potentially not known to all the involved parties.

Ugh, people bringing in outside-the-game relationships to the game itself will ruin Diplomacy. "Tom and Jim never betray each other, and if one is in a position to sacrifice themselves to give the other the win, they always will" is how you get a group to never ever let Diplomacy hit the table after the first couple times. Plus a bunch of other games.

Folks who play like that are game-group poison. Hell, they can even make RPGs a lot less fun with that crap.

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#129

Post by squeaky-clean »

bee_rider wrote: post #9
kneebonian wrote: post #5

For those hearing of this game for the first time and think it sounds fun. Be warned, it is considered to be a game that will end friendships that have lasted for years, and monopoly is considered to be a game that causes less bad feelings. An AI may be able to speak like a person but will never be able to hang onto that long burning simmering hatred from when Brad didn't support my army and instead flipped on me by…

I have heard this about various games (Risk and Settlers of Catan mostly). I don’t get it. The point of these games is to be a bastard. If everyone goes into it with the understanding that there will be double crosses, how could there be hurt feelings? Monopoly is worse; it is just boring, I would dump my friends if they suggested monopoly not because I was hurt by their ruthless gameplay but for their terminally tas…

Different players have different mental "lines that shouldn't be crossed". I play Civ 6 cloud games with friends from college who now live around the world. (No turn timer, you get a Steam notification when it's your turn). Sometimes someone will spend literal weeks on a turn trying to make agreements for war declarations or for world-congress votes.

The time that crossed the line: Poland wanted to declare war on Greece, no one else wanted to get involved on either side, and it was a pretty even match between them.

A friend not involved in this game was visiting family in the same city as the Greece-player, so we knew he'd be dropping by to visit him too. Poland-player told the "neutral" friend: if Greece-player shows you his civ game, take a picture of the screen when he's not looking and message it to Poland-player.

Well he did it, Poland declared war, and his knowledge of the position of troops lead to him winning the war.

"How did you know I didn't have any troops in my southern cities?" And Poland told him how he knew. It didn't end the friendship but there was about a month of not talking to any of us. When he cooled down there was a long meeting over whether that was cheating or "All is fair in Love and Civ". We could never come to a real agreement, 3 in favor of cheating, 3 in favor of dastardly but legal. But we now have an explicit rule of no screen sharing of any kind.

Re: CICERO: An AI agent that negotiates, persuades, and cooperates with people

#130

Post by bpodgursky »

wolverine876 wrote: post #79
bpodgursky wrote: post #26

Earlier quoted context omitted.

Well, yes, "largely" honest, until the critical moment when you stab to take 18 supply centers to win the game. You don't win Diplomacy by staying honest, you win by choosing the right moment to make the move and burn that trust. It's the 5% dishonesty that matters.

It's interesting and I think significant that people are uncomfortable with positive values, such as honesty, doing good for others, responsibility to others, right (not wrong), etc. We shoot them down, similar to how people instinctively cut off a conversation going in an uncomfortable direction, often without even realizing it. I can't attribute that the parent - I don't know the individual - but I expected a choru…

When people are concerned about AI alignment, they are not concerned about an AI that is a pathological liar, lying for no reason.

They are concerned about an AI which is believable day-to-day but is secretly optimizing for its own goals, which are only exposed when it eventually makes a deceitful move it cannot disguise, but succeeds because it now has sufficient control.

That's literally what the AI is doing here; being honest until the moment it is able to stab everyone else and throw them under the table.

Post reply on HN