Live data from Hacker News

Superintelligence: The Idea That Eats Smart People

idlewords.com

111–120 of 607 posts

Re: Superintelligence: The Idea That Eats Smart People

#111
post #33
post #27

"Put another way, this is the premise that the mind arises out of ordinary physics... If you are very religious, you might believe that a brain is not possible without a soul. But for most of us, this is an easy premise to accept." The thing that irks me about this is how it reinforces a common (and in my opinion, false) dichotomy: either you believe the mind is explicable in terms of ordinary physics or you believe…

That's just vitalism: https://en.wikipedia.org/wiki/Vitalism Either everything exists in the material world, or it doesn't. There's really no way of avoiding that binary. If you think there's something else, that is by definition supernatural.

> If you think there's something else, that is by definition supernatural.

First, how others perceive your words usually matters more than the precise definitions you have in mind. If I describe myself as believing in the supernatural, it has a lot of connotations I don't want.

Second, the possibility that consciousness (in some sense) could be built into physics themselves. So it doesn't contradict that the brain is made of subatomic particles, but the workings of the universe have more correlations built in that could work at different levels. Something I think is comparable is that many cosmologists think that the arrow of time, which events come before which, can be explained by a universe with initial conditions of extreme low entropy. So there's nothing within the universe that explains why the initial conditions were like that, but it's a real property of our universe.

Maybe consciousness could be an end state that the universe is progressing toward. Is that really so much weirder than working from an initial state of extremely low entropy?

Re: Superintelligence: The Idea That Eats Smart People

#112
>Eventually it gets to a near-superhuman level, where it's funnier than any human being around it.

>>My belt holds up my pants and my pants have belt loops that hold up my belt.

>>What's going on down there?

>>Who is the real hero?

I love that he used a Mitch Hedberg joke for this.

Re: Superintelligence: The Idea That Eats Smart People

#113

"I live in California, which has the highest poverty rate in the United States, even though it's home to Silicon Valley. I see my rich industry doing nothing to improve the lives of everyday people and indigent people around us." This is trivially false. Over a hundred billionaires have now pledged to donate the majority of their wealth, and the list includes many tech people like Bill Gates, Larry Ellison, Mark Zuck…

The ACA could barely roll out a website without tragic failure, how have cell phones "dramatically improved" the lives of the poor? They're still subject to as much bureaucracy and denial of basic services as ever. 4G hasn't improved public transpo.

I suppose the poor are no longer subject to long-distance fees during daytime.

Re: Superintelligence: The Idea That Eats Smart People

#114
post #80

I feel like this essay is missing a key point around defining intelligence. Machines can be trained to emulate intelligence, but machines are not themselves intelligent. Our neural nets can drive cars, convert speech to text, recognize images, and maybe even carry on a conversation. But there's no light behind the eyes. It's all synthetic. It's an emulation which mimes intelligence through the brute force of observin…

The only reason we don't have a clean, cogent 'definition of intelligence' is because people like you blindly refuse to accept the possibility that machines can be intelligent. You're demanding that someone explain why black and white are different colors while requiring them to conclude that the night sky and the sun must look the same.

Re: Superintelligence: The Idea That Eats Smart People

#115
post #54

Earlier quoted context omitted.

The roundworm (c. elegans) only has 302 neurons, and about 7,000 synapses, but is capable of social behavior, movement, and reproduction. The entire connectome has been mapped, and we understand how many of these behaviors work without having to resort to additional ontological entities like your "third way". If this complex behavior can be explained using only 302 neurons, I have no doubt that the complexity of huma…

Are you sure? My understanding is that this connectome has been rather unfruitful in explaining its behavior.

We can't explain everything completely right now. However, for example, we can model behaviors like klinotaxis and movement toward chemical gradients using only 10 neurons [0]! I find it completely fascinating — we don't have the full picture, but we can isolate different behaviors and examine how the neurons contribute to that action.

[0] https://www.youtube.com/watch?v=D3_BjL20Roc

Re: Superintelligence: The Idea That Eats Smart People

#116

Earlier quoted context omitted.

There's no reason that something else can't exist in the material world, I think the parent is just pointing out the third way is thinking there's something else material outside our current understanding. If God exists, there's no reason there couldn't be new phyisics describing how his world works.

If the something else is physical but outside of our current understanding, then it doesn't prevent us from creating AI by simply simulating a biological brain. Thus, that is the same as the physicalist view in the context of the argument in question.

You need to know what tovsimulate though. But we could imagine to create an "ai" from pure meat. Grey matter linked to sensor and ouput systems. Kinda nightmarish

Re: Superintelligence: The Idea That Eats Smart People

#118

"I live in California, which has the highest poverty rate in the United States, even though it's home to Silicon Valley. I see my rich industry doing nothing to improve the lives of everyday people and indigent people around us." This is trivially false. Over a hundred billionaires have now pledged to donate the majority of their wealth, and the list includes many tech people like Bill Gates, Larry Ellison, Mark Zuck…

The ACA could barely roll out a website without tragic failure, how have cell phones "dramatically improved" the lives of the poor? They're still subject to as much bureaucracy and denial of basic services as ever. 4G hasn't improved public transpo. I suppose the poor are no longer subject to long-distance fees during daytime.

"how have cell phones "dramatically improved" the lives of the poor?"

There's tons of stuff on this, but, eg., here's a poster from USAID:

https://s-media-cache-ak0.pinimg.com/originals/09/35/2d/0935...

Re: Superintelligence: The Idea That Eats Smart People

#119

Earlier quoted context omitted.

I'm not arguing that it's useless to outsmart a cat. I'm disputing the assumption that being vastly smarter means your opponent is hopelessly outmatched and at your mercy. If you're the first human on an island full of tigers, you're not going to end up as the Tiger King.

What if you're the first human on an island full of baby tigers? I think most AI alarmists would argue that this analogy is vastly more appropriate.

Please put me on this island.

Re: Superintelligence: The Idea That Eats Smart People

#120

While I agree with Maciej's central point, I think the inside arguments he presents are pretty weak. I think that AI risk is not a pressing concern even if you grant the AI risk crowd's assumptions. Elided from https://alexcbecker.net/blog.html#against-ai-risk : The real AI risk isn't an all-powerful savant which misinterprets a command to "make everyone on Earth happy" and destroys the Earth. It's a military AI that…

It's possible that we could face both AI risks consecutively! First a tiny hyperclass conquers the world using a limited superintelligence and commits mass genocide, and then a more powerful superintelligence is created and everyone is made into paperclips. Isn't that a cheery thought. :-)
Post reply on HN