A Canvas Made of Pixels
claybavor.com
A Canvas Made of Pixels
1–10 of 111 posts
Re: A Canvas Made of Pixels
#2Nice job!
If you have a camera that tracks the viewer, you can also make the image it displays 3D as seen in this video from 2007: https://youtu.be/Jd3-eiid-Uw?t=2m46s (back then it used a Wiimote to track the head position).
Re: A Canvas Made of Pixels
#3>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall.
Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the next. Depending on the "distance" (angle) traveled by the eye, this can last up to tens of milliseconds. Enough time to do some cool stuff!
One of the studies that conclusively showed this effect, a fairly long time ago, had participants wear some elaborate headgear that allowed the researchers to track where the eyes of their participants were looking at. They had them look at a standard sentence like
"the quick brown fox jumped over the lazy dog",
but with a twist! Every word in the sentence was masked, except for the word the participant would be focusing on at that moment. So if he focused on the word fox, the screen would show
"xxx xxxxx xxxxx fox xxxxxx xxxx xxx xxxx xxx".
Whenever the system detected a saccade by the eyes, they would recalculate which word the participant would be looking at (e.g. switch to dog), and changed the display of the screen accordingly, now showing
"xxx xxxxx xxxxx xxx xxxxxx xxxx xxx xxxx dog"
Participants were asked if they noticed anything strange about the sentence, but they reported there was nothing strange about it! (Disregarding having a heavy set of mirrors strapped to your head).
My point: If you were able to detect saccades of the eyes, and relatively accurately calculate their position, you could have the region of the image that's unattended be colourful noise, the theory says that your visitors would be none the wiser (of course this would break down with multiple people looking at the same image)
Even cooler: procedurally re-generate parts of the image that are unattended, so that you're looking at an ever shifting image, but wouldn't quite be able to pin down what's happening. Similar to this video: https://www.youtube.com/watch?v=ubNF9QNEQLA
Re: A Canvas Made of Pixels
#4>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…
This is also the principle behind foveated rendering (https://en.wikipedia.org/wiki/Foveated_imaging) where you only render the graphics in high detail where the viewer is looking, and use a low-res image for the rest with the goal of saving computing power. Big area of development right now for VR!
Re: A Canvas Made of Pixels
#5So... when will you start a Kickstarter campaign?
Re: A Canvas Made of Pixels
#6Nice job! If you have a camera that tracks the viewer, you can also make the image it displays 3D as seen in this video from 2007: https://youtu.be/Jd3-eiid-Uw?t=2m46s (back then it used a Wiimote to track the head position).
Do you think a camera would be precise enough? This looks pretty awesome.
Re: A Canvas Made of Pixels
#7>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…
Thanks for the explanation, that was great!
I imagine you could play Where's Waldo without changing screens. Just "find the next Waldo" on an ever changing scenario. The moment you find one, another is created at other spot.
Could be very addictive, although sounds kind of stressfull also.
Re: A Canvas Made of Pixels
#8A cool effect would be to have the painting actually looking at you using face recognition.
Freaky.
Re: A Canvas Made of Pixels
#9Hogwarts paintings!
Re: A Canvas Made of Pixels
#10Wow this is incredibly cool! I love the shy feature especially, to screw with the viewer :P
One question I have, though, is that since the aspect ratio of the screen is fixed, does that mean that all the photos have to be rescaled? That is kinda inelegant, I wonder if there's a way to fix it.