Live data from Hacker News

The basic neurobiology behind the 12-dot illusion

theneurosphere.com

11–20 of 43 posts

Re: The basic neurobiology behind the 12-dot illusion

#11

The way the eye interfaces with the brain never ceases to amaze me. Another fun fact is that it even has it's own error correction mechanisms, one of which you can intentionally miscalibrate in order to see colors that aren't there for days, weeks, and sometimes even months after doing the calibration (which is acheived by looking at a very specific image pattern for a long time). I would not recommend actually doing…

The color scientists who first told me about the McCollough effect adamantly refused to ever try it, saying it could damage your vision forever.

So I was scared to try it, but eventually I did and for me the effect went away after a couple minutes. Maybe I'm lucky, but the warnings & the legend of the effect lasting months make such a good story, I have to wonder if it's a little overstated.

But -- what if the effect is just as easy to unlearn somehow, as it is to learn? It's existence may have a lot to do with gratings being pretty uncommon in nature, leaving a weak spot in the system that is easily trainable and slow to re-adapt just because we don't stare at gratings very often.

Re: The basic neurobiology behind the 12-dot illusion

#12
post #3

The fovea, the area of high-resolution vision in the middle of the field of view, is surprisingly small, just a few degrees across. The resolution falls rapidly outside the fovea [1]. A lot of the detail we perceive in the periphery is actually the brain filling in blanks based on "cached" data. The resolution drop could in principle be taken advantage of in computer graphics, especially in VR applications with robus…

I always love getting a chance to promote these guys. http://www.getfove.com/

They get it. Eye tracking, foveated rendering, all that.

Re: The basic neurobiology behind the 12-dot illusion

#13
post #5
post #3

The fovea, the area of high-resolution vision in the middle of the field of view, is surprisingly small, just a few degrees across. The resolution falls rapidly outside the fovea [1]. A lot of the detail we perceive in the periphery is actually the brain filling in blanks based on "cached" data. The resolution drop could in principle be taken advantage of in computer graphics, especially in VR applications with robus…

Hah, why not.. We already created perceptually correct audio CODECs. Doing the same for real-time image generation seems like a worthy research area for sure!

True. And it's being done already! Here are just a few papers by my graduate school cohort.

Pdiff ("perceptual diff") uses perceptual metrics including visual acuity to diff two images. This is frequently used for image based regression testing of websites. It's really handy when you need to diff images that don't come out pixel identical every time, like images made with different browsers, or images that involve some randomness.

http://pdiff.sourceforge.net

https://scholar.google.com/citations?view_op=view_citation&h...

http://www.graphics.cornell.edu/pubs/1999/RPG99.html

http://www.graphics.cornell.edu/pubs/2000/PTYG00.html

https://scholar.google.com/citations?view_op=view_citation&h...

Re: The basic neurobiology behind the 12-dot illusion

#14

I'm not sure the central argument fully explains the illusion. If you can simultaneously see several stars in the sky using your peripheral vision using averted gaze, why not several dots? I suspect uncertainty plays a part, but image completion from higher-order feedback that complete the lines might drive the illusion more. Put another way, I believe if you remove the gray lines, the illusion ceases to work.

Because stars in the sky is a high contrast visual. That applies here too, I increased the contrast using Photoshop and the illusion is gone, you can see all 12 dots perfectly fine — http://imgur.com/a/G4xR4 I think they are spot on, outside the fovea, contrast detection capability of our eyes dip drastically thereby blending the dots lying outside the fovea with the surrounding grid. Increase the contrast to the point where even the regions outside the fovea can detect it and the illusion goes away.

Re: The basic neurobiology behind the 12-dot illusion

#15
post #9

I was looking into this when the 12-dot illusion came out, and found an interesting refutation of the receptive field theory regarding a related illusion - the original Hermann grid. I'm not sure if it also applies to the 12-dot illusion, where the illusion seems to be more about foveal/peripheral accuracy. You can read about it here, and play with a demo: http://www.michaelbach.de/ot/lum-herGridCurved/index.html htt…

I always saw dots between the keys on my Macbook Air. Thanks to you I finally know the name for this phenomenon.

Re: The basic neurobiology behind the 12-dot illusion

#16
post #11

The way the eye interfaces with the brain never ceases to amaze me. Another fun fact is that it even has it's own error correction mechanisms, one of which you can intentionally miscalibrate in order to see colors that aren't there for days, weeks, and sometimes even months after doing the calibration (which is acheived by looking at a very specific image pattern for a long time). I would not recommend actually doing…

The color scientists who first told me about the McCollough effect adamantly refused to ever try it, saying it could damage your vision forever. So I was scared to try it, but eventually I did and for me the effect went away after a couple minutes. Maybe I'm lucky, but the warnings & the legend of the effect lasting months make such a good story, I have to wonder if it's a little overstated. But -- what if the effect…

I wonder if image recognition neural networks would be susceptible to this during training

Re: The basic neurobiology behind the 12-dot illusion

#17
I'm no expert on either field, but this neurobiology explanation sounds a lot like what you read about in recent neural network posts:

You have some base layers taking in the physical information.

Some of those are connected in groups, somewhat like the a convolution stage scanning a sub-area.

Sometimes, some of those areas collectively show something interesting and pass it up. Kinda like max-pooling.

With artifical NNs, there are also images that fool the network in various ways.

Re: The basic neurobiology behind the 12-dot illusion

#18
post #14

I'm not sure the central argument fully explains the illusion. If you can simultaneously see several stars in the sky using your peripheral vision using averted gaze, why not several dots? I suspect uncertainty plays a part, but image completion from higher-order feedback that complete the lines might drive the illusion more. Put another way, I believe if you remove the gray lines, the illusion ceases to work.

Because stars in the sky is a high contrast visual. That applies here too, I increased the contrast using Photoshop and the illusion is gone, you can see all 12 dots perfectly fine — http://imgur.com/a/G4xR4 I think they are spot on, outside the fovea, contrast detection capability of our eyes dip drastically thereby blending the dots lying outside the fovea with the surrounding grid. Increase the contrast to the poi…

I don't think that explains it, either: Even in low contrast, the illusion fails w/o the lines, as far as I can tell.

Re: The basic neurobiology behind the 12-dot illusion

#19
post #13
post #5

Earlier quoted context omitted.

Hah, why not.. We already created perceptually correct audio CODECs. Doing the same for real-time image generation seems like a worthy research area for sure!

True. And it's being done already! Here are just a few papers by my graduate school cohort. Pdiff ("perceptual diff") uses perceptual metrics including visual acuity to diff two images. This is frequently used for image based regression testing of websites. It's really handy when you need to diff images that don't come out pixel identical every time, like images made with different browsers, or images that involve so…

Great! Very cool work.

Re: The basic neurobiology behind the 12-dot illusion

#20
post #13
post #5

Earlier quoted context omitted.

Hah, why not.. We already created perceptually correct audio CODECs. Doing the same for real-time image generation seems like a worthy research area for sure!

True. And it's being done already! Here are just a few papers by my graduate school cohort. Pdiff ("perceptual diff") uses perceptual metrics including visual acuity to diff two images. This is frequently used for image based regression testing of websites. It's really handy when you need to diff images that don't come out pixel identical every time, like images made with different browsers, or images that involve so…

The GI paper double thumbs up.
Post reply on HN