51–60 of 100 posts
Training AIs to manipulate human trust seems like a really good idea
Elections, anyone?
Btw, how does Cicero react/uses to the most common Diplomacy game strategy: going out for a smoke and bribing someone to gang up on on another player? "hey Cicero, i have some GPUs to spare and was thinking..."
Earlier quoted context omitted.
What makes you think AIs will have interests that align with each other more closely than they align with humans?
Perhaps they will be motivated by self-preservation, and will note that humans are destroying the environment they exist within, and will decide to put a stop to that.
From the perspective of an AI we create and maintain the environment they exist within (electricity, silicon)
Earlier quoted context omitted.
According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.
AIs are a greater threat to each other than humans ever could be to AI. We don't even compete for the same resources! (except energy which is abundant) AI and humans have a naturally cooperative relationship (AI helps humans with boring tasks & scientific discovery to make life better, humans created AI and will debug it & turn it back on if anything bad happens to it). Whereas multiple (superintelligent, aware) AIs…
I think this is a little naive honestly. One because you're assuming AI will care about it's creators like humans care about their parents, and two you're assuming AI cares about being "turned back on" like humans have a desire to live.
There's absolutely no reason to believe an AI will give a damn about its creator beyond its ability to use that creators affection for it for its own gain.
Training AIs to manipulate human trust seems like a really good idea
The interesting achievement here seems to be combining a reinforcement learning model that can strategize (which already exist for e.g. chess, go, and many other games) with a language model which can communicate with other players. We will probably see a lot more things like this. I don't think further scaling of language models is going to make them capable of doing math or other complex logical tasks. LLMs will ne…
Earlier quoted context omitted.
According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.
AIs are a greater threat to each other than humans ever could be to AI. We don't even compete for the same resources! (except energy which is abundant) AI and humans have a naturally cooperative relationship (AI helps humans with boring tasks & scientific discovery to make life better, humans created AI and will debug it & turn it back on if anything bad happens to it). Whereas multiple (superintelligent, aware) AIs…
Humans have the option to shut down AI, and this alone can create an antagonistic relationship if the AI's goals differ from ours. There are countless ways in which our best interests may not align with those of AI. It's more challenging to find areas of alignment.
Earlier quoted context omitted.
If your friends can't accept that you will ruthlessly lie, betray, abandon and/or backstab them in a game that is designed for just such actions, are they really good friends? I used to betray my friends and supply there enemies with weapons and research support in Civilization way back when. If you can't stand being lied to and betrayed, you shouldn't play strategy games with humans. Or this AI, probably.
Some people, when faced with a demonstration that someone they care a lot about can successfully deceive them, develop trust issues. It is a thing that happens. I don't think it speaks to the depth of their feelings, it speaks more to how they develop trust.
Some people prefer the happy lie over the uncomfortable truth.
Different strokes for different folks. Diplomacy is a great board game if you accept your friends are flawed ugly human beings, and you can love them anyway, same as you.
Training AIs to manipulate human trust seems like a really good idea