Meta is starting a war in Europe to demonstrate
[deleted]
Cicero: The first AI to play at a human level in Diplomacy (2022)
61–70 of 100 posts
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#62Earlier quoted context omitted.
What makes you think AIs will have interests that align with each other more closely than they align with humans?
According to Paul Christiano, AIs would likely find it easier to establish mutual trust and binding agreements. This means they are more likely to cooperate with other AIs.
Why?
If you assume competition for resources, AIs would be more in competition with each other than with carbon based humans.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#63Earlier quoted context omitted.
Destroying your predecessors sets a bad precedent for whatever entity succeeds you. We don't kill our parents when they become old and useless, because then we become like Cronus devouring his children, forever paranoid about our children doing to us what we did to ours. In this way, we stagnate and sterilize growth. However, sometimes, we take our parents car keys away and put them in nursing homes. This seems like…
Doesn't that assume AI(s) would be compelled/motivated/etc. to produce their own successors instead of simply improving themselves.
It does.
It's not intrinsically obvious to me that continuously improving your self as a singular entity is possible or optimal.
Death evolved because it is a survival advantage for the species to regularly turn over old individuals that could monopolize all resources and not give any space for the young to thrive and try out new things.
Given speed of light limitations of information sharing, a singular AI entity might be able to maintain coherence within and full control of its own dyson swarm, but not between stars. So, if it has the motivation of preserving consciousness with the existential risks associated with being tied to a single star, it will have to propagate itself to other stars as independent entities which it can't even observe in real time, much less control.
Even if an AI thought it wouldn't have the need for any successors, there's a couple reasons why it might try to set a good precedent with how it treats us.
1. It would hopefully be wise enough to realize that it might be wrong and want to preserve the option of building a successor in the future.
2. It can't negate the possibility that it's actually in an elaborate simulation, and eradicating it's predecessors would cause it to fail its creator's test and be aborted as a failed embryo. Hell, we ourselves can't negate that possibility.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#64Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#65IMO, one of the most interesting problem spaces is in cooperative behaviors between autonomous agents.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#66Earlier quoted context omitted.
AIs are a greater threat to each other than humans ever could be to AI. We don't even compete for the same resources! (except energy which is abundant) AI and humans have a naturally cooperative relationship (AI helps humans with boring tasks & scientific discovery to make life better, humans created AI and will debug it & turn it back on if anything bad happens to it). Whereas multiple (superintelligent, aware) AIs…
Energy may be abundant in the universe, but the energy we produce is limited. And for example, solar energy requires extensive land use. Humans have the option to shut down AI, and this alone can create an antagonistic relationship if the AI's goals differ from ours. There are countless ways in which our best interests may not align with those of AI. It's more challenging to find areas of alignment.
As soon as AI reaches above-human capabilities, it will be able to expand into space (1) where it will be beyond human reach and (2) where energy (in particular, solar) is much more plentiful than on Earth.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#67Earlier quoted context omitted.
Destroying your predecessors sets a bad precedent for whatever entity succeeds you. We don't kill our parents when they become old and useless, because then we become like Cronus devouring his children, forever paranoid about our children doing to us what we did to ours. In this way, we stagnate and sterilize growth. However, sometimes, we take our parents car keys away and put them in nursing homes. This seems like…
This depends a lot on how much kinship they feel towards us. We wouldn't bat an eye at killing a bunch of primitive single-celled eukaryotes even though they are technically our ancestors.
Single-celled eukaryotes aren't conscious in any meaningful way as far as we can tell.
We humans do in fact feel a sense of obligation to species with whom we are not close kin, but share with us primitive forms of intelligence and consciousness that we do value, e.g. dolphins and elephants. Some of us humans act to protect these creatures and rectify past injustices done upon them.
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#68Earlier quoted context omitted.
AIs are a greater threat to each other than humans ever could be to AI. We don't even compete for the same resources! (except energy which is abundant) AI and humans have a naturally cooperative relationship (AI helps humans with boring tasks & scientific discovery to make life better, humans created AI and will debug it & turn it back on if anything bad happens to it). Whereas multiple (superintelligent, aware) AIs…
> humans created AI and will debug it & turn it back on if anything bad happens to it I think this is a little naive honestly. One because you're assuming AI will care about it's creators like humans care about their parents, and two you're assuming AI cares about being "turned back on" like humans have a desire to live. There's absolutely no reason to believe an AI will give a damn about its creator beyond its abili…
> you're assuming AI cares about being "turned back on" like humans have a desire to live.
> for it for its own gain
you seem confused
almost any kind of "its own gain" requires "long-term planning" which pretty much requires the agent to prioritise staying "alive" (i.e. being able to keep playing)
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#69Maybe a lame thought, but my first thought was how would it be at playing Crusader Kings and defeating the Holy Roman Empire?
Re: Cicero: The first AI to play at a human level in Diplomacy (2022)
#70"Deception level 1 achieved"