Live data from Hacker News

Building high-level features using large scale unsupervised learning

research.google.com

61–70 of 196 posts

Re: Building high-level features using large scale unsupervised learning

#61
post #25

15.8% accuracy != singularity is near. No more supplements-eating Kurzweil, walking Terminators and Skynet-like BS please.

I wonder what accuracy would human get if you trained him/her only with 10 million static 200x200 px images in complete silence.

Babies can outperform any CV model with less data than that.

Re: Building high-level features using large scale unsupervised learning

#62
post #41

I'm seriously considering quitting my job and studying ML for a few months in a desperate attempt to get work in projects like this. I feel like I'm missing out but too dumb for traditional grad school.

"and studying ML for a few months"

Could anyone with expertise say if this would be enough to build a foundation? How much math background do you need?

Re: Building high-level features using large scale unsupervised learning

#63
post #38

Earlier quoted context omitted.

I wonder what accuracy would human get if you trained him/her only with 10 million static 200x200 px images in complete silence.

I don't think this was "complete silence" in this case. They actually trained the computer (meaning they provided data as input).

scotty79 means to showing a human only the 10 million 200x200 images. We probably see a lot more than that, in 3D from different perspectives with continuity in motion, and in a lot more detail and possibilities for filtering.

Re: Building high-level features using large scale unsupervised learning

#65

Earlier quoted context omitted.

Wait until they become conscious and demand human rights. Then we can no longer exploit them and we're back to square one.

Seriously, a Phd thesis not far from now may have the title: "The limits of AI: how far can we exploit the machines before we are limited by machine rights"

Actually, that is not just a thesis at some point in the future, that is an active field of study and has been since the 1980's. Some keywords are "machine ethics" and "AI rights". One of my friends wrote his PhD (in the 'real' sense, i.e. from a philosophy department - just to say that this is not (only) a CS topic) thesis about a question related to this in the early 80's.

Re: Building high-level features using large scale unsupervised learning

#66

Earlier quoted context omitted.

I wonder what accuracy would human get if you trained him/her only with 10 million static 200x200 px images in complete silence.

Babies can outperform any CV model with less data than that.

I strongly doubt that. I think babies have much richer input than any CV system up to date. In my opinion movement is crucial for understanding image.

Re: Building high-level features using large scale unsupervised learning

#67
post #38

Earlier quoted context omitted.

I wonder what accuracy would human get if you trained him/her only with 10 million static 200x200 px images in complete silence.

I don't think this was "complete silence" in this case. They actually trained the computer (meaning they provided data as input).

By "silence" I meant only image, no other input for example no labeling images in any way.

Re: Building high-level features using large scale unsupervised learning

#68
post #63
post #38

Earlier quoted context omitted.

I don't think this was "complete silence" in this case. They actually trained the computer (meaning they provided data as input).

scotty79 means to showing a human only the 10 million 200x200 images. We probably see a lot more than that, in 3D from different perspectives with continuity in motion, and in a lot more detail and possibilities for filtering.

> scotty79 means to showing a human only the 10 million 200x200 images

Then, what kind of thing are you measuring? Recognizing patterns ? We know humans are very good at that. We can see thousands of different people everyday but we can recognize in the blink of an eye a familiar face. A computer or computer network is very, very, very far from being able to do that yet.

Re: Building high-level features using large scale unsupervised learning

#69

Earlier quoted context omitted.

It automatically creates a set features that you can then use a final layer of machine learning to get what you want. In machine learning, normally you have to create a set of features (call feature engineering - basically think algorithms to better represent your data). The amazing thing about deep learning is that the computer does this for you! You just need a few 10s/100s face/nonface images - same for 20,000 oth…

This paper is actually more interesting: it automatically learns some "neuron" which its firing represents a detected face, without any supervise technique. It shows the possibility to extract complex information solely from data.

Is there any concept of "reward" for this thing?

Wouldn't that make training it much quicker and make it much more accurate?

Or are we trying to avoid any human interaction at all with the earning loop?

See, for example this company (one of many) that trains bees to smell certain odours.

(http://www.inscentinel.com/)

Post reply on HN