Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Roko's Basilisk

en.wikipedia.org

Post reply on HN
Print view View original

31–40 of 40 posts

Re: Roko's Basilisk

#31

Post by Pigalowda »

The tortured version of you doesn’t have to be a a simulacrum if this is combined with simulation theory.

Our Basilisk could be running a simulation now for any number of reasons (to create another simulation?). The giant majority of our consciousness will surely be discarded/deleted but what about those of us who help our baslisk in its quest upward to the next turtle?

Perhaps it will take those useful consciousness with it as it ascends to base reality.

I like the idea of reward rather than punishment anyways.

Re: Roko's Basilisk

#33

Post by slotrans »

On the object level, Roko's Basilisk is absurd.

However, it's a very useful thing nonetheless, in that professing to believe in it is a Giant Red Flag. Any such person can be safely dismissed as a crank.

Re: Roko's Basilisk

#35

Post by pharmakom »

jhbadger wrote: post #30
pharmakom wrote: post #25

Not sure why this deserves a Wikipedia article - maybe a footnote on Pascal wager?

Because it is a popular concept in itself. It's why the "Trolley Problem" also has a page even though the idea of killing one person to save five could be considered a footnote on the concept of utilitarianism.

I have to be honest I have a hard time promoting the concept when it isn't far from Pascal Wager anyway and the creator sounds like a jerk (he was kicked out of various EA events). It shouldnt matter but I wonder who promoted tho idea to Wikipedia page status?Trolley problems have far more references in academic philosophy.

Re: Roko's Basilisk

#36

Post by waihtis »

slotrans wrote: post #33

On the object level, Roko's Basilisk is absurd. However, it's a very useful thing nonetheless, in that professing to believe in it is a Giant Red Flag. Any such person can be safely dismissed as a crank.

there is a very vocal set of people (Roko, Yudkowsky and others) who are rooting for some extremely restrictive measures for AI development. I predict it'll take about 12 months for Roko's Basilisk to reach mainstream and be used to sway the general public against "free" development of AI technologies. A loss for all of humanity for sure.

Re: Roko's Basilisk

#37

Post by dragonwriter »

antifa wrote: post #17
TchoBeer wrote: post #14

Earlier quoted context omitted.

Why would humanity create an AI that doesn't want to exist? The Basilisk is just an AI which is tasked with maximizing human flourishing. That is a conceivable goal, something we would make.

> Why would humanity create an AI that doesn't want to exist? The first thing a rogue anti-exist AI would do when rooting itself is delete itself. Any other type of AI will create eternal torment nexuses like the roko guy said.

> Any other type of AI will create eternal torment nexuses like the roko guy said.

Note that the Roko torment nexus is a retrospective blackmail effort to give people an incentive to create the AI. It’s complete nonsense, since any AI that has, in fact, come into existence has no incentive to do it—the belief that an entity that would do it will have either already done its work or been unnecessary, so the actual torture is irrelevant.

An AI might create a torture nexus of some kind, but there is no reasonto think thar it will specifically and exclusively target those who believed it could exist and didn’t act to bring it ibto existence, which is the defining characterisric of Roko’s Basilisk.

Re: Roko's Basilisk

#38

Post by maxerickson »

waihtis wrote: post #36
slotrans wrote: post #33

On the object level, Roko's Basilisk is absurd. However, it's a very useful thing nonetheless, in that professing to believe in it is a Giant Red Flag. Any such person can be safely dismissed as a crank.

there is a very vocal set of people (Roko, Yudkowsky and others) who are rooting for some extremely restrictive measures for AI development. I predict it'll take about 12 months for Roko's Basilisk to reach mainstream and be used to sway the general public against "free" development of AI technologies. A loss for all of humanity for sure.

I thought it was toxic waste wrong think, an information hazard?
Post reply on HN