Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cicero: The first AI to play at a human level in Diplomacy (2022)

ai.meta.com

Post reply on HN
Print view View original

31–40 of 100 posts

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#31

Post by mitthrowaway2 »

TapWaterBandit wrote: post #8
v64 wrote: post #4

Interesting video from a pro Diplomacy player playing against multiple instances of Cicero and giving commentary during the game [1]. I can see how there would be people that observe AIs engaging in this kind of strategic planning and extrapolate that to how they may behave if they were to cooperatively make plans against us. [1] https://www.youtube.com/watch?v=u5192bvUS7k

What makes you think AIs will have interests that align with each other more closely than they align with humans?

According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#34

Post by ggambetta »

andrewstuart wrote: post #10

Diplomacy is a great board game but only play it if you're OK with your relationships coming to an end.

That's why I only play anonymously and online. I'd very much rather not play this with friends, let alone with my partner.

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#37

Post by lern_too_spel »

polygamous_bat wrote: post #25
dwroberts wrote: post #21

I remember reading this paper about this time exactly a year ago - why isn’t 2022 in the title?

I assume the paper went through peer review and finally got published in Science.

It was published in Science more than a year ago. I was assuming there was a retraction when it appeared at the top of the front page, but no, it's just a repost.

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#38

Post by tomp »

mitthrowaway2 wrote: post #31
TapWaterBandit wrote: post #8

Earlier quoted context omitted.

What makes you think AIs will have interests that align with each other more closely than they align with humans?

According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.

AIs are a greater threat to each other than humans ever could be to AI.

We don't even compete for the same resources! (except energy which is abundant)

AI and humans have a naturally cooperative relationship (AI helps humans with boring tasks & scientific discovery to make life better, humans created AI and will debug it & turn it back on if anything bad happens to it).

Whereas multiple (superintelligent, aware) AIs have a naturally antagonistic relationship ("you using GPU cycles means that I'm not using those GPU cycles").

Possibly the biggest fear of an AI would be a "split brain" situation.

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#39

Post by wavemode »

The interesting achievement here seems to be combining a reinforcement learning model that can strategize (which already exist for e.g. chess, go, and many other games) with a language model which can communicate with other players.

We will probably see a lot more things like this. I don't think further scaling of language models is going to make them capable of doing math or other complex logical tasks. LLMs will need to be combined with other models for specialized tasks if we want them to become more general purpose.

Re: Cicero: The first AI to play at a human level in Diplomacy (2022)

#40

Post by thesz »

mitthrowaway2 wrote: post #31
TapWaterBandit wrote: post #8

Earlier quoted context omitted.

What makes you think AIs will have interests that align with each other more closely than they align with humans?

According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.

According to Vladimir Lenin [1], the problem with quotes on the Internet is that people immediately believe in their authenticity.

[1] https://www.quotes.net/quote/77867

Can you elaborate on why AI will find it easier to establish mutual trust and binding agreements?

Post reply on HN