DeepMind researcher: Existential catastrophe caused by AI is likely unavoidable

Post by arrow7000 » Thu, Sep 15, 2022, 1:31 AM UTC

nealabq wrote: post #10

SilverBirch wrote: post #2

The problem I have with this is that yes, I understand the possibilty of peverse incentives, but let's look at our real world experience. When we play a game with a smart animal or a child and they figure out how to cheat in order to get their reward we don't suddenly become lobotomized. We see their cheating, and generally find it amusing or cute. In the same way I think it's one thing to say that an AI might cheat…

This (funny) YT video by exurb1a agrees: https://www.youtube.com/watch?v=dLRLYPiaAoA

Post by vinibrito » Thu, Sep 15, 2022, 4:19 AM UTC

runnerup wrote: post #5

kranke155 wrote: post #4

Earlier quoted context omitted.

As long as human beings have control of the energy grid and the physical world, how are AIs going to outcompete us in a way detrimental to our interests ? Last case scenario we can always find them and delete them. ?

At historical rates of power-efficiency scaling (which haven't changed much in the past 10 years either) ... by 2040 we'll have the currently estimated computational power of a human brain (~1 exaflop) running on a 20Watt processor, which is about as much as an iPhone CPU uses. It's not guaranteed that some AI supercomputer will be using megawatts of electricity and couldn't siphon what it needs from small parasitic…

Post by picsao » Thu, Sep 15, 2022, 5:15 AM UTC

SilverBirch wrote: post #2

The problem I have with this is that yes, I understand the possibilty of peverse incentives, but let's look at our real world experience. When we play a game with a smart animal or a child and they figure out how to cheat in order to get their reward we don't suddenly become lobotomized. We see their cheating, and generally find it amusing or cute. In the same way I think it's one thing to say that an AI might cheat…