The Existential Risk of AGI

Speculating about existential risk is certainly important, but way too easy to overstate. It can easily become distracting and actually dangerous in itself.

Here’s a good take on it: https://www.ai-breakout.com/post/ai-alignment-and-the-messia...

I also think we would all be very wise to remember the story of Henny Penny / “Chicken Little”. https://americanliterature.com/childrens-stories/henny-penny...

Specifically, the danger brought by hysteria. In our case, Alignment is probably much more effective and achievable when the widest possible community of researchers and engineers have access to knowledge, and much more perilous if they don’t because deluded parties thought it should be contained to a much smaller elite “secure” group.

Re: The Existential Risk of AGI

#7

Post by ubu7737 » Sat, Oct 14, 2023, 11:28 PM UTC

[dead]

Re: The Existential Risk of AGI

#8

Post by ubu7737 » Sat, Oct 14, 2023, 11:30 PM UTC

i_like_apis wrote: post #6

Speculating about existential risk is certainly important, but way too easy to overstate. It can easily become distracting and actually dangerous in itself. Here’s a good take on it: https://www.ai-breakout.com/post/ai-alignment-and-the-messia... I also think we would all be very wise to remember the story of Henny Penny / “Chicken Little”. https://americanliterature.com/childrens-stories/henny-penny... Specifically,…

[dead]

Re: The Existential Risk of AGI

#9

Post by devmor » Sat, Oct 14, 2023, 11:31 PM UTC

I’m not worried about AGI at all, because the rise of generative machine learning has taught me that humanity in general is so bad and/or uninterested in verifying facts that we will likely wipe out our species through the stupidest possible propaganda campaigns before we ever achieve AGI.

Re: The Existential Risk of AGI

#10

Post by bilsbie » Sat, Oct 14, 2023, 11:32 PM UTC

29athrowaway wrote: post #5

The risk of AGI with as much as 60 points of IQ, is the emergence of private robot armies and neofeudalism.

On the other hand self checkout still hasn’t replaced cashiers after 30 years.