Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Building high-level features using large scale unsupervised learning

research.google.com

Post reply on HN
Print view View original

21–30 of 196 posts

Re: Building high-level features using large scale unsupervised learning

#21

Post by frisco »

marshallp wrote: post #12
forgotusername wrote: post #6

Can we perhaps edit "singularity is near" out of the title? This sounds impressive, but having a bunch of racks able to classify the outline of a face is vastly disconnected from machine and humanity merging.

It does this for 20,000 different objects categories - this is getting close to matching human visual ability (and there are huge societal implications if computer reach that standard). This is the most powerful AI experiment yet conducted (publicly known).

> This is the most powerful AI experiment yet conducted (publicly known).

That's an ill-defined statement. AI is a vast and diverse field: what makes one demonstration more "powerful" than another? There are definitely other projects that could be viewed as being in the same class of "powerful" as this cluster.

This is certainly an interesting paper, but it has to be viewed in the context of a large and active field.

Re: Building high-level features using large scale unsupervised learning

#22

Post by gnaritas »

ADRIANFR wrote: post #16
chrischen wrote: post #3

Earlier quoted context omitted.

Wait until they become conscious and demand human rights. Then we can no longer exploit them and we're back to square one.

Seriously, a Phd thesis not far from now may have the title: "The limits of AI: how far can we exploit the machines before we are limited by machine rights"

I'd say until they day they realize they're being exploited, and complain about it.

Re: Building high-level features using large scale unsupervised learning

#23

Post by marshallp »

frisco wrote: post #21
marshallp wrote: post #12

Earlier quoted context omitted.

It does this for 20,000 different objects categories - this is getting close to matching human visual ability (and there are huge societal implications if computer reach that standard). This is the most powerful AI experiment yet conducted (publicly known).

> This is the most powerful AI experiment yet conducted (publicly known). That's an ill-defined statement. AI is a vast and diverse field: what makes one demonstration more "powerful" than another? There are definitely other projects that could be viewed as being in the same class of "powerful" as this cluster. This is certainly an interesting paper, but it has to be viewed in the context of a large and active field.

That's true. Let's say in machine learning then.

Re: Building high-level features using large scale unsupervised learning

#24

Post by semisight »

This isn't singularity material. While this may not be a bog standard neural network, it has no feedback. It cannot think, because thinking requires reflection. It is trained by adjusting the weights of the connections after the fact using an equation.

Is it cool, and perhaps even useful? Yes. But don't confuse this research project for a precursor to skynet.

Re: Building high-level features using large scale unsupervised learning

#26

Post by marshallp »

semisight wrote: post #24

This isn't singularity material. While this may not be a bog standard neural network, it has no feedback. It cannot think, because thinking requires reflection. It is trained by adjusting the weights of the connections after the fact using an equation. Is it cool, and perhaps even useful? Yes. But don't confuse this research project for a precursor to skynet.

I put the singularity bit in to make it relevant to people who would otherwise not get the significance of this (which is that large scale neural nets can work - something people have been trying and failing at for decades).

Re: Building high-level features using large scale unsupervised learning

#28

Post by tansey »

marshallp wrote: post #12
forgotusername wrote: post #6

Can we perhaps edit "singularity is near" out of the title? This sounds impressive, but having a bunch of racks able to classify the outline of a face is vastly disconnected from machine and humanity merging.

It does this for 20,000 different objects categories - this is getting close to matching human visual ability (and there are huge societal implications if computer reach that standard). This is the most powerful AI experiment yet conducted (publicly known).

> It does this for 20,000 different objects categories

With 15.8% accuracy.

> This is the most powerful AI experiment yet conducted (publicly known).

It's only powerful because they threw more cores at it than anyone else has previously attempted. From a quick skimming of the paper, there does not appear to be a lot of novel algorithmic contribution here. It's the same basic autoencoder that Hinton proposed years ago. They just added in some speed ups for many cores.

It's a great experiment though. You shouldn't detract from its legitimate contributions by making outlandish claims.

Re: Building high-level features using large scale unsupervised learning

#29

Post by jfoutz »

kenrikm wrote: post #7

While I'm excited about progress, 15.8% accuracy is not exactly "Singularity is near"

before, there was room to double accuracy 3 times. Now, there's not. If i understood correctly their approach can take advantage of parallelism. I'm not saying they can just throw 128k cores at the problem and be done, adding 2^n resources will likely have a nice boost to results.

OTOH, it's late and i might be way off.

Re: Building high-level features using large scale unsupervised learning

#30

Post by MindTwister »

panacea wrote: post #27

The singularity is already here. There are black holes in our universe. This submission title really annoys me.

Even if you are trolling, I think I'll leave this here. http://en.wikipedia.org/wiki/Technological_singularity
Post reply on HN