Edge detection doesn’t explain line drawing
11–20 of 174 posts
Re: Edge detection doesn’t explain line drawing
#12As someone (probably like many here) who graduated from a university which taught computer vision and peripheral neuroscience courses, with such titles as "Computational Neuroscience of Vision", I always felt that trying to understand the human brain as a kind of algorithm was a bit of an artefact of computer scientists as they approach biology. The truth is the visual cortex is vast, and not sufficient to explain th…
Re: Edge detection doesn’t explain line drawing
#13Ten years or so ago I was working on a video chip that had an upscaler feature. While prototyping and simulating it, we first started by applying a mathematically-correct (i.e. information preserving) FIR filter to do the upscale. Then we compared the result with other solutions and found that ours looked worse. We asked our colleagues to blind-test it and they all picked third-party-scaled images over ours. At first…
Our cortext is all about interpreting what we see. Almost before our brain proper has the data, nerves have begun extracting information (edges etc). Probably because it was the difference between hitting and missing the animal with the spear. Or seeing or missing the tiger in the grass.
Re: Edge detection doesn’t explain line drawing
#14A hand could appear on you retina in different sizes and orientations. According to distance, the size will grow and shrink. But the center of symmetry will stay the same.
This goes further. There's also a center of symmetry between edges, and higher-level features as well. Our brain has no issue detecting these.
Re: Edge detection doesn’t explain line drawing
#15An interesting concept to put in a story anyway.
Re: Edge detection doesn’t explain line drawing
#16As someone (probably like many here) who graduated from a university which taught computer vision and peripheral neuroscience courses, with such titles as "Computational Neuroscience of Vision", I always felt that trying to understand the human brain as a kind of algorithm was a bit of an artefact of computer scientists as they approach biology. The truth is the visual cortex is vast, and not sufficient to explain th…
ah, someone who paid attention in lecture! (incidentally; there’s a fairly deep literature of historians of science that have carefully documented that we describe ourselves as analogous to the most sophisticated technology of the day: see “to lose one’s temper”, “to blow a gasket”, “i got my wires crossed”, “sorry, cache miss”, … as metaphors and idioms of mental state through the centuries that reflect the cool tec…
Are we living on an island that floats on a giant turtle’s back? Or are the heavens like giant clockworks? Or maybe it’s all a computer simulation?
These cosmological speculations are separated by thousands of years, but they are all simply a reflection of what the person finds most awe-inspiring in their everyday life.
Re: Edge detection doesn’t explain line drawing
#17Is this necessarily a problem in the argument? If we consider e.g. color, and construct a blurry image that has a color distribution very similar to a real face, but doesn't fire the edge detection in the same way, we can still recognize it as a face. This could just mean that a sufficiently close match to other examples of the same class on any one of the strong "dimensions" of the image our brain processes is sufficient to make us recognize it, no? The author makes it sound like if edge detection is what makes us recognize line drawings, this implies that our brain discards every other feature in attempts to recognize visual input, but I don't think that's a sound conclusion.
Re: Edge detection doesn’t explain line drawing
#18Why does the explanation need to go to that direction?
Line drawings have a liking to the thing being depicted.
They're a crude representation of it (compared to a photograph or a photo-realistic oil painting) but are nonetheless a represenation.
That's why they work, in the sense of people understanding what they show: they share similar patterns with the things being show. And we are pattern matches.
In this case the patterns are edge patterns, but it could just as well be non-edge patterns. Imagine a color drawing of a human face, where the ink drawn edges have been removed, and it's just blocks of color for the head, the eyes, the pupils, the mouth, the nostrils, ears, etc. We could still tell it's a face, even if we applied some gaussian blur to those blocks.
>The most basic statement of the problem with Lines-As-Edges is that the human visual system isn’t just an edge detector. You can see colors, you can see absolute intensities. You can tell the difference between a thin black line and the silhouette of a dark object against a light background; we have both kinds of receptors in the primary visual cortex, as well as others. Yet Lines-As-Edge supposes that the vision system discards all of this other information present in an image, for just this one special case. Why?
Isn't this taking things backwards?
It's not the vision system which "discards all of this other information present in an image" in our regular operation.
Rather, it's the line drawing with does away with (discards) all of this other information and only focuses on a thing's edges.
In other words, our visual system has capabilities A, B, C (say edge detection, color, 3d placement, etc). And, a line drawing gives it only A - which is still enough.
When our visual system also gets B and C, it can perceive objects even better. But for merely identifying something, A is apparently enough.
What I described here is totally compatible with Lines-As-Edges hypothesis, and makes sense too, so I don't see where the author's issue is, and why he thinks the fact that "the human visual system isn’t just an edge detector" invalidates the lines-as-edges hypothesis.
>Now you get a sense of the color of the object, and not just its outlines. How would one generalize Lines-As-Edges to account for these different types of depiction? The visual system is no longer ignoring everything aside some gradients; it’s now paying attention to some colors (and not others).
Yeah, so? It just means that the visual system can work with less or with more (and multi-type) information.
Lines-as-edges is a hypothesis for why line drawings "work" (are recognizable as the thing). The hypothesis doesn't say however that edges are the only thing the visual system can understand.
So, there's no need to "generalize Lines-As-Edges to account for these different types of depiction".
Lines-as-edges explains how line drawings are understood, period.
Line drawings with shading and color, add additional information, aside from the edges.
That's fine: no proponent of Lines-As-Edge ever said that the visual system only works with edges. Just that it works with edges when interpreting a line drawing which only offers edges.
Re: Edge detection doesn’t explain line drawing
#19I remember reading that most optical illusions don't work on people raised in remote tribes in the Amazon, as their visual perception has been 'fine-tuned' for jungle contours, instead of the straight lines in the west.
Is it possible that we _learn_ how to perceive line drawings in our early years?
Re: Edge detection doesn’t explain line drawing
#20Earlier quoted context omitted.
ah, someone who paid attention in lecture! (incidentally; there’s a fairly deep literature of historians of science that have carefully documented that we describe ourselves as analogous to the most sophisticated technology of the day: see “to lose one’s temper”, “to blow a gasket”, “i got my wires crossed”, “sorry, cache miss”, … as metaphors and idioms of mental state through the centuries that reflect the cool tec…
And also the universe itself is often seen through the lens of contemporary technology. Are we living on an island that floats on a giant turtle’s back? Or are the heavens like giant clockworks? Or maybe it’s all a computer simulation? These cosmological speculations are separated by thousands of years, but they are all simply a reflection of what the person finds most awe-inspiring in their everyday life.