Live data from Hacker News

AI doomism is quickly becoming indistinguishable from an apocalyptic religion

twitter.com

31–40 of 244 posts

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#32
Everything is turned into an existential risk these days. People are prone to believe in apocalyptic predictions because they fear the unknown and rely on flawed mental heuristics. Apocalyptic predictions automatically illicit skepticism from me.

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#33

I've seen multiple top people in AGI space say that total annihilation threat from AGI exists. I think I've heard Karpathy say something along the lines of worst case scenario of AGI is worse than a nuclear armageddon on Lex Friedman podcast. Honestly the fear of AGI worst-case scenario is worse than any other fear I've experienced. I've accepted the fact that I can die a long time ago, I was afraid but mortality is…

> We've had inquisitions historically, I would very much support a global AI inquisition.

You know how inquisition usually goes. "You've been playing starcraft against 'the AI'. What do you have to say in your defense?"

Maybe I'm just weird, but "a tech-based superintelligence emerges and decides to destroy humanity because it was in a bad mood" is something I'm totally fine with. Doom-Cults on the other hand I don't like at all.

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#34

I've seen multiple top people in AGI space say that total annihilation threat from AGI exists. I think I've heard Karpathy say something along the lines of worst case scenario of AGI is worse than a nuclear armageddon on Lex Friedman podcast. Honestly the fear of AGI worst-case scenario is worse than any other fear I've experienced. I've accepted the fact that I can die a long time ago, I was afraid but mortality is…

AI can also completely liberate all of us. This fear mongering is irrational. We already live in an extremely advanced reality, with organic life having organic nanomachines performing incredibly complex operations in a universe, in realtime, performing impossibly complex calculations. Even to simulate a square meter of our universe in realtime is outlandishly beyond our compute access. Perhaps AI unleashes the creat…

"Things might be fine"? This doesn't seem like a sufficiently convincing take?

It takes 20 years of due diligence and environmental impact studies just to build a single hydroelectric dam, if not 50. Why should our attitude toward AI be to shrug and hope for the best?

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#35
I wouldn't be surprised if OpenAI has been running a model in the background that is reinforcing itself. Honestly, it's very possible they've made a lot of progress in that area.

I think GPT-4 will be a baseline for quite some time before the next "ChatGPT moment" is ready. I think they've got some really smart people working at OpenAI who are not just programmers, but genuine hackers who want to hack this world just for the fun of it.

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#36

I've seen multiple top people in AGI space say that total annihilation threat from AGI exists. I think I've heard Karpathy say something along the lines of worst case scenario of AGI is worse than a nuclear armageddon on Lex Friedman podcast. Honestly the fear of AGI worst-case scenario is worse than any other fear I've experienced. I've accepted the fact that I can die a long time ago, I was afraid but mortality is…

AI can also completely liberate all of us. This fear mongering is irrational. We already live in an extremely advanced reality, with organic life having organic nanomachines performing incredibly complex operations in a universe, in realtime, performing impossibly complex calculations. Even to simulate a square meter of our universe in realtime is outlandishly beyond our compute access. Perhaps AI unleashes the creat…

> If it happens, there is no stopping it anyway.

Fatalism is notably a religious sentiment

An incredible ai upside is possible as is an incredible ai downside. Blind optimism and fatalism has no relation to what the truth of it will be

https://en.m.wikipedia.org/wiki/Fatalism

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#38
post #2

There are a lot of religious like beliefs about things as people have moved away from traditional religions. I wonder if it is in our nature to have something bigger than ourselves to believe in based on faith in the message

Perhaps organized religion was a Chesterton’s Fence that we removed at our own peril.

I dunno where you live but from my vantage point it hasn't really been removed.

Re: AI doomism is quickly becoming indistinguishable from an apocalyptic religion

#39
post #3

I mean, Yann is paid by Meta to propagate an "only positive vibes" stance. "AI doomism" itself is a ridiculous phrase meant to demonize anyone with legit concerns, of which there are many. I say this as someone who is very excited about recent developments and sees the potential upside as well as anyone, I think.

Yann is also known for constantly denigrating the abilities of LLMs and being comically wrong all the time, saying they can't do X only to be proven wrong immediately after. He's pretty much a meme at this point. He spent all his years at FB building ivory towers of mathematics attempting the analytical route for building AI systems only to be out done by the bitter lesson. He's perpetually salty about the current st…

Didn't he hype the Galatica LLM?
Post reply on HN