Live data from Hacker News

Rationality: From AI to Zombies

intelligence.org

141–142 of 142 posts

Re: Rationality: From AI to Zombies

#141
post #61

Earlier quoted context omitted.

The release dates were purposefully close together.

I don't have inside knowledge, but yeah, it seems extremely likely -- the sequences have been available for years, after all.

They didn't wait for the end of HPMoR to publish this book - they made an extra effort to have it ready in time!

Re: Rationality: From AI to Zombies

#142
post #140

Earlier quoted context omitted.

> I assume there's some level of pain that you would prefer to the specks; say a single second of torture, equivalent to a smack or such. Quite possibly I prefer a world with one person tortured for a lifetime compared to 3|||3 specks if they are evaluated out of context. It's hard to say, because pain doesn't easily sum, there are different qualities of pain, and we are talking about situations where we may be losin…

>Let's say you tell those 3|||3 who wanted to save someone from torture by accepting a speck in their eye that they cannot, and someone must be tortured instead. You've massively increased the unhappiness in the world - not only is an individual getting tortured, but 3|||3 have ended up with a situation that's worse than they wanted. Are you going to claim that it's still got a higher utility? Now that you notice tha…

> Nobody is told about any of this. If they were, that would itself need to be factored in, and quite possibly lead me to prefer specks.

Exactly. My whole contention is that the reason this question is considered unintuitive by so many people is that they're really considering a different question to the one you think you're asking.

Post reply on HN