Live data from Hacker News

A Canvas Made of Pixels

claybavor.com

41–50 of 111 posts

Re: A Canvas Made of Pixels

#41
post #3

>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…

Your video reminded me of this selective attention test: https://www.youtube.com/watch?v=vJG698U2Mvo. This Wikipedia article also seems to be related to the phenomenon and talks about the video too: https://en.wikipedia.org/wiki/Inattentional_blindness.

Re: A Canvas Made of Pixels

#42
post #3

>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…

This is also the principle behind foveated rendering ( https://en.wikipedia.org/wiki/Foveated_imaging ) where you only render the graphics in high detail where the viewer is looking, and use a low-res image for the rest with the goal of saving computing power. Big area of development right now for VR!

I've seen this idea used in machine learning as well.

There was a paper [1] whose goal was a binary classification of the center pixel in a region of interest. Interestingly, their results improved when they applied a foveal blurring surrounding the pixel to be classified.

[1]: http://people.idsia.ch/~juergen/nips2012.pdf

Re: A Canvas Made of Pixels

#43
"Visitors to Microsoft chairman Gates' new mansion in Medina will find themselves in an electronic Disneyland where they will be able to "call up" a favorite painting or photograph on combination TV-computer screens.

"Right now, only a billionaire could afford to try $80,000 monitors and $150,000 computer-storage devices (the house could have several) that may be needed to make this all work."

from "Bill Gates: 50,000 Computer Paintings On Call" (1991)

http://community.seattletimes.nwsource.com/archive/?date=199...

Re: A Canvas Made of Pixels

#44

Earlier quoted context omitted.

This is also the principle behind foveated rendering ( https://en.wikipedia.org/wiki/Foveated_imaging ) where you only render the graphics in high detail where the viewer is looking, and use a low-res image for the rest with the goal of saving computing power. Big area of development right now for VR!

I've seen this idea used in machine learning as well. There was a paper [1] whose goal was a binary classification of the center pixel in a region of interest. Interestingly, their results improved when they applied a foveal blurring surrounding the pixel to be classified. [1]: http://people.idsia.ch/~juergen/nips2012.pdf

Interesting! Thanks for sharing!

There are algorithms that mimic fixation paths the eyes follow when presented with a novel image, very much related to modeling dopaminergic systems. It seemed to find task-relevant information dense areas first, and then slowly spread out to less information dense areas. I wonder if there'd be any benefit to running these algorithms on images, basically turning them into a video, and then running classifiers based on this video (with or without foveal blurring

Re: A Canvas Made of Pixels

#45
post #3

>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…

M$ research has AWESOME stuff on foveated graphics. They essentially track your eye movement and only render detail in the specific spot on the display you are looking out. Everything outside your eye's focus area is still rendered but a a much lower quality. Saves immense amounts of resources, imagine your gpu only having to render 20% of the screen at a time!

http://research.microsoft.com/apps/pubs/default.aspx?id=1766...

Re: A Canvas Made of Pixels

#46
post #30

A color hi-res e-ink display would be a much better fit for the project: it requires power only to change the image and doesn't need light sensors. Too bad e-ink isn't being developed anymore.

http://www.eink.com/ appear to be doing development and a year ago releasead a colour eink display. Alas the resolution and 4096 colour range is somewhat adrift from the requirements of such a use as in photo realism. Indeed the market that will boost this area will be supermarket labeling upon shelfs and the like. Even recently a few bus stops in London utilising eink for displaying a bus timetible http://www.gizmodo.co.uk/2015/12/tfls-trial-of-clever-eink-l...

But totaly agree it is aperfect fit for such display technology, alas the technology is still a long way off being suitable for this niche usage. Albeit the whole refresh aspect and power usage make it not ideal for current technology, at least the aspect of screen burn-in and ghosting are less considerations from the old CRT days (though they could do a better colour range technology wise).

Re: A Canvas Made of Pixels

#47
post #3

>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…

This is also the principle behind foveated rendering ( https://en.wikipedia.org/wiki/Foveated_imaging ) where you only render the graphics in high detail where the viewer is looking, and use a low-res image for the rest with the goal of saving computing power. Big area of development right now for VR!

I just posted this in another comment, but M$ research has awesome foveated rendering: http://research.microsoft.com/apps/pubs/default.aspx?id=1766...

Re: A Canvas Made of Pixels

#48
post #45
post #3

>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…

M$ research has AWESOME stuff on foveated graphics. They essentially track your eye movement and only render detail in the specific spot on the display you are looking out. Everything outside your eye's focus area is still rendered but a a much lower quality. Saves immense amounts of resources, imagine your gpu only having to render 20% of the screen at a time! http://research.microsoft.com/apps/pubs/default.aspx?id=…

As an analog to lossy compression - lossy rendering?

Re: A Canvas Made of Pixels

#49

He says in the article that "Apple did a good job with their monitor", but what he fails to realize is that the panel in that monitor is made by Samsung, and is used in numerous other monitors, such as a bunch of Dell Ultrasharp monitors. These are the exact same monitor, except with a different frame and stand, and are available for a fraction of the cost.

Actually, unless it's changed with the 5k screen, the iMac displays are made by LG. Samsung makes the display for the iPad.

Re: A Canvas Made of Pixels

#50
I'm a big fan of flux, but brightness adjustment is another story.

On my iPad, I quickly turned it off. The auto-brightness never hit the spot I wanted, and switched too strongly and too late. Reading on the bus, the brightness basically goes berserk at every shadow and never settles. At home it would be more manageable, but unfortunately desktop monitors don't support brightness adjustments as far as I know -- really wish it was standard through HDMI.

Having to put an entire iMac computer on the wall to have access to brightness adjustments (at least that's my understanding of the solution) makes it a lot less practical. But kudos to the author for addressing that essential part of the problem.

Post reply on HN