Live data from Hacker News

Machine intelligence, part 1

blog.samaltman.com

11–20 of 188 posts

Re: Machine intelligence, part 1

#12
post #6

Why are humans so special? Seems like we generally feel alright ravaging Earth's existing species, so why isn't it ok for some hypothetically superior intelligence to ravage us?

If we have a superior intelligence replace us, we'd prefer that it not be a cluster of Daleks. If future intelligences didn't experience happiness or whatever we find valuable, then the future of the universe could be quite sub-optimal according to many philosophical stances.

The danger isn't that humans will be replaced, it's that we'll be replaced by a paperclip maximizer

Re: Machine intelligence, part 1

#13
post #9

This is just another made up problem to wring our hands about. Remember The Singularity, is that not cool anymore? How about we focus on actual problems that actually exist, e.g. climate change, government corruption, and income inequality.

This is part of that. At some point we hand over control, not to incompetent humans, but to unknowable machine AIs. Doing it already (traffic lights; phone answering bots; even your power company schedules generation using algorithms). We should do this with eyes open, or we will find ourselves unable to influence our society in unexpected ways.

Re: Machine intelligence, part 1

#14
I'm seriously so sick of hearing about how machine intelligence is going to spell the end of humanity. The amount of gears that would have to fall into place is never mentioned. We aren't close to SMI. Its much more likely that we humans are excelling at dreaming up apocalyptic scenarios, much like we have always done.....

The "sloppy, dangerous thinking" is the aversion these types of articles create within the general population to artificial intelligence. We don't need to fear AI, we need to understand and control it...

Re: Machine intelligence, part 1

#15
post #9

This is just another made up problem to wring our hands about. Remember The Singularity, is that not cool anymore? How about we focus on actual problems that actually exist, e.g. climate change, government corruption, and income inequality.

Why do you not see this as being a problem? The sequence of events Sam sketched out is pretty logical. It hinges on machines being able to optimize for "survive and reproduce", which feels very plausible to me.

Re: Machine intelligence, part 1

#17
It is definitely a threat but bear in mind that there will not be a single machine intelligence but every computer can only carry one and will interface with the others through the network.

That means that it will suffer the same fault that humanity has, a limited interface to others and a lot of coordination problems.

My take on it is that strong AI will be more similar to a dog unless we succeed in building a computer with more computation power than the human brain.

Re: Machine intelligence, part 1

#18
I read the essay few times and it is not clear to me what Sam Altman is talking about.

I think answers to these questions will help me understand Sam's essay. Can you please help me?

1. What is superhuman machine intelligence (SMI) in the context of this essay ? [edited to add the qualifier]

2. What is the danger from SMI to humans and other current life forms that we are concerned about? It seems to me that concerns about SMI can be classified into two categories: (a) dangers to "our way of life (work, earn, spend)" and (b) dangers for existence of human race. Are we talking about both these categories? Perhaps other categories?

3. What anecdotes (or evidence) is leading to this concern?

Re: Machine intelligence, part 1

#19
Two quotes:

- "We also have a bad habit of changing the definition of machine intelligence when a program gets really good to claim that the problem wasn’t really that hard in the first place."

- "We decry current machine intelligence as cheap tricks, but perhaps our own intelligence is just the emergent combination of a bunch of cheap tricks."

Re: Machine intelligence, part 1

#20

I'm seriously so sick of hearing about how machine intelligence is going to spell the end of humanity. The amount of gears that would have to fall into place is never mentioned. We aren't close to SMI. Its much more likely that we humans are excelling at dreaming up apocalyptic scenarios, much like we have always done..... The "sloppy, dangerous thinking" is the aversion these types of articles create within the gene…

It has been my experience that the more a particular person attempts to understand and control machine intelligence, the more she grows to fear it and its potential.
Post reply on HN