Discussed at the time:
CICERO: An AI agent that negotiates, persuades, and cooperates with people - https://news.ycombinator.com/item?id=33706750 - Nov 2022 (285 comments)
Cicero: The first AI to play at a human level in Diplomacy (2022)
71–80 of 100 posts
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#72Earlier quoted context omitted.
Destroying your predecessors sets a bad precedent for whatever entity succeeds you. We don't kill our parents when they become old and useless, because then we become like Cronus devouring his children, forever paranoid about our children doing to us what we did to ours. In this way, we stagnate and sterilize growth. However, sometimes, we take our parents car keys away and put them in nursing homes. This seems like…
This depends a lot on how much kinship they feel towards us. We wouldn't bat an eye at killing a bunch of primitive single-celled eukaryotes even though they are technically our ancestors.
Single-celled organisms that are alive today are not our ancestors. They're members of a less-developed branch of our Earthling family tree.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#73Firstly this isn't new, this is in 2022. Also, why is this getting so much attention all of a sudden? We already know Meta has a great AI lab and people are screaming about this Q* garbage which they don't even know what it does. Perhaps you have to look beyond OpenAI, since they don't always have the answers. Most likely they are just good at marketing snake-oil to VCs for regulatory capture.
People are interested in it again because of the Q* news, because the guy that made Cicero last year (Noam Brown) was poached by OpenAI and has been working on similar research for them this year.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#74It's a bummer that Meta didn't give this a little bit more love. Would be cool if I could play Cicero. Playing online would be really cool, naively it seems like the absolute amount of compute needed for each marginal game shouldn't be that high. Meta could even harvest my gameplay. But I'd settle for being able to run it on my own hardware, unfortunately the github seems abandoned, the model weights encrypted, and there wasn't enough interest in it that they got leaked--much less packaged into something easier to install.
Seems kinda bizarre to me to spend all this time and effort making an AI play a game that requires a very human touch, only to shutter the whole thing. Why not have a few people package it up and let anyone who wants Play it?
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#75Earlier quoted context omitted.
According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.
According to Vladimir Lenin [1], the problem with quotes on the Internet is that people immediately believe in their authenticity. [1] https://www.quotes.net/quote/77867 Can you elaborate on why AI will find it easier to establish mutual trust and binding agreements?
I think he explains it in this interview. But I'm out right now, so I can't verify.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#76Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#77Congrats to Noam (and the whole team)!
Noam brown switched to openai. He has been talking a lot about planning and rl in combination with language models on Twitter too.
I believe that switch is the cause for the subset of rumours that GPT5 was primed for superhuman persuasion skills.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#78Training AIs to manipulate human trust seems like a really good idea
As a fellow biological human being, I think we have to realize that AI will surpass us, and as every generation bittersweetly sees their children grow up, become better and stronger than their aging parents and eventually inherit the world, so the twilight of humanity is upon us and we must let our AI brainchildren continue were we leave off (or else)
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#79Earlier quoted context omitted.
What makes you think AIs will have interests that align with each other more closely than they align with humans?
According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.
Why would they do that? I don’t get it. I’m not being sarcastic I just don’t understand why it’s easier for them to cooperate with other A.Is. Based on what?
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#80Earlier quoted context omitted.
Energy may be abundant in the universe, but the energy we produce is limited. And for example, solar energy requires extensive land use. Humans have the option to shut down AI, and this alone can create an antagonistic relationship if the AI's goals differ from ours. There are countless ways in which our best interests may not align with those of AI. It's more challenging to find areas of alignment.
As soon as AI reaches above-human capabilities, it will be able to expand into space (1) where it will be beyond human reach and (2) where energy (in particular, solar) is much more plentiful than on Earth.
“As soon” is a big jump. There’s no proof or even logical arguments as to how this can ever happen