This whole thing is gross. The sycophantic worship of Sam is gross and the paranoid AI safety people are insane. The singularity cultists are also insane. What happened? I remember when most of the people in this industry were at least okay. A little weird but okay. Of course judging by social media it’s a microcosm of the rest of society. People are utterly losing their minds everywhere. It’s both scary and amusing.
i feel the same way api but I did watch this entire thing https://www.youtube.com/watch?v=AaTRHFaaPG8 and now I can't stop thinking about Eliezer is so smart, smarter than me, should I listen?
Eliezer is filling the traditional doomsday prophet archetype, of which there have been thousands in history. That doesn’t mean he’s wrong, but should immediately raise questions.
A deeper analysis of his ideas shows there are fundamental problems in his reasoning.
First, He’s been consistently wrong about the future development and results in AI research so his understanding of AI is proven to be superficial.
Second, His doomsday scenarios are based on a fundamental fallacy; that a GAI smarter than humans would be insanely stupid, unable to self reflect or solve moral quandaries. That’s not to say AI cannot be dangerous, but the types of doomsday scenarios he presents are unlikely. For instance because of acausal trade, Rokos Basilisk is a serious risk that should be treated properly, but Elizer denies it.