Live data from Hacker News

Machine Learning Confronts the Elephant in the Room

quantamagazine.org

21–30 of 116 posts

Re: Machine Learning Confronts the Elephant in the Room

#21

Why can't you just train the network on artificially altered photos, with "elephants" randomly scattered around, until it is robust to them?

Because there's always another type of 'elephant' to be thrown in. The networks are just not inherently robust against unexpected features (I'll call them outliers for want of a better term), and this is what needs to be fixed, and not increasing the variety and frequency of outliers.

Re: Machine Learning Confronts the Elephant in the Room

#22

Why can't you just train the network on artificially altered photos, with "elephants" randomly scattered around, until it is robust to them?

This study shows something more fundamental about the way that neural networks process images, other than just that random elephants are a problem. Rather than break the image down into constituent parts and reason about them individually, they use global context to help them classify. This lets them outperform humans on some tasks. The problem is if you show it something completely different to anything it has ever seen before (like a T-rex with a cane and monocle riding a bear), it will not reliably output something sensible.

To an extent it shows the gap between neural networks being able to classify things, and actually being able to understand what they are seeing, which will always limit their utility beyond classifying images that look like other images they've seen before.

Re: Machine Learning Confronts the Elephant in the Room

#23
post #21

Why can't you just train the network on artificially altered photos, with "elephants" randomly scattered around, until it is robust to them?

Because there's always another type of 'elephant' to be thrown in. The networks are just not inherently robust against unexpected features (I'll call them outliers for want of a better term), and this is what needs to be fixed, and not increasing the variety and frequency of outliers.

Doesn’t increasing the frequency and variety of outliers just make them no longer outliers?

Re: Machine Learning Confronts the Elephant in the Room

#24
post #21

Earlier quoted context omitted.

Because there's always another type of 'elephant' to be thrown in. The networks are just not inherently robust against unexpected features (I'll call them outliers for want of a better term), and this is what needs to be fixed, and not increasing the variety and frequency of outliers.

Doesn’t increasing the frequency and variety of outliers just make them no longer outliers?

Indeed.

Re: Machine Learning Confronts the Elephant in the Room

#25

Can't they implement a "virtual representation" or sort of ideal or archetypical scene in an AIs memory that's quickly accessible, and then use that to diff "new unexpected stuff" and refocus on that difference somehow?

If we had such a representation and the mapping from real world (images) to it, we'd basically solved all image recognition tasks because the above is the definition of an image recognition task

Re: Machine Learning Confronts the Elephant in the Room

#26

Why can't you just train the network on artificially altered photos, with "elephants" randomly scattered around, until it is robust to them?

Are you going to repeat this with every object that exists, or could exist?

No, you see neural networks are specially afraid of elephants. Just like elephants are especially afraid of mice. And so the circle continues, all the way around to humans who are especially afraid of neural networks and what they will do to society.

Re: Machine Learning Confronts the Elephant in the Room

#27
post #18
post #14

Earlier quoted context omitted.

Parent is not sarcastic. Automated recognition systems are systems , which means they are made of several components (sensors, databases, hardwares, softwares) working together. Neural networks are one of those sub-components and no one ever claimed that neural networks are 100% accurate and sufficient to build automated decision systems. The problem described in the article is taken into account when building system…

The problem described in the article is taken into account when building systems (like autonomous cars) using neural networks. Where can I find more information on this?

This is a vast engineering field studied before the existence of neural networks.

Keywords are "control theory", "sensor fusion", "automated decision under uncertainty" that you can look on Google, Wikipedia and arXiv. Also "Simultaneous localization and mapping" which is a good example of using uncertain data points from different sensors to build a representation of the reality.

In those systems, a neural network is just another sensor providing augmented information.

Re: Machine Learning Confronts the Elephant in the Room

#28

Why can't you just train the network on artificially altered photos, with "elephants" randomly scattered around, until it is robust to them?

Are you going to repeat this with every object that exists, or could exist?

What I'd do is train it on a large diverse set of foreign objects, then test it with a different diverse set of foreign objects, to see if it is possible to make it generally robust. Basically, the goal is that any feature which is not overlapping with the "elephant" should not be influenced by it.

Re: Machine Learning Confronts the Elephant in the Room

#29
post #26

Earlier quoted context omitted.

Are you going to repeat this with every object that exists, or could exist?

No, you see neural networks are specially afraid of elephants. Just like elephants are especially afraid of mice. And so the circle continues, all the way around to humans who are especially afraid of neural networks and what they will do to society.

I am sorry to inform you that this post is not that funny.

Re: Machine Learning Confronts the Elephant in the Room

#30
Please, correct me if I'm wrong, but isn't the whole machine learning testing approach based on the recognition the whole image at once in full resolution in one attempt? If so, it's not how animals see and observe the world and this could be a key difference between AI and living beings.

What if an algorithm actually had a focused sight? Look at the brightest feature, blur the rest, then try to find another distinctive details, look closer into the parts of the image until the most of it becomes clear. Let other neural network control the scanning process and loop until it develops some confidence in the result. Can it work that way?

Post reply on HN