Nice job! If you have a camera that tracks the viewer, you can also make the image it displays 3D as seen in this video from 2007: https://youtu.be/Jd3-eiid-Uw?t=2m46s (back then it used a Wiimote to track the head position).
Do you think a camera would be precise enough? This looks pretty awesome.
I had a quick go at this a few months back using Apple's CIDetector[1], and even at 'high' accuracy that didn't seem precise enough — it was distractingly jiggly.
I'm really surprised there's no photos of the build process. It's hard to tell if this is actually what is being described, or just a blog post around a photo of a framed image.
Nice job! If you have a camera that tracks the viewer, you can also make the image it displays 3D as seen in this video from 2007: https://youtu.be/Jd3-eiid-Uw?t=2m46s (back then it used a Wiimote to track the head position).
up close the lack of parallax would give it away, but I think it would work ok if the viewer is sufficiently far away.
Wow this is incredibly cool! I love the shy feature especially, to screw with the viewer :P One question I have, though, is that since the aspect ratio of the screen is fixed, does that mean that all the photos have to be rescaled? That is kinda inelegant, I wonder if there's a way to fix it.
I think the mat around the photo is also rendered, so you can have whatever aspect you want - although a portrait image might look a bit lost in the middle of it.
Next step - mount the frame on a motorised bearing so it can rotate 90 degrees depending on the image aspect!
>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…
This is also the principle behind foveated rendering ( https://en.wikipedia.org/wiki/Foveated_imaging ) where you only render the graphics in high detail where the viewer is looking, and use a low-res image for the rest with the goal of saving computing power. Big area of development right now for VR!
That's really cool! I'm not 100% sure, but what I remember from reading a few psych papers about this is that as long as the "mask" is similar to the original in a few easy to calculate sampling statistics (colour distribution, overall hue), it doesn't actually need to look anything like the original image, even calculating low-res imagery shouldn't be necessary. Our peripheral vision is just that bad (at least for static imagery, movement detection is actually pretty good). The foveated part is where the magic happens, and we've gotten pretty good at fooling ourself into believing this "foveated" part is much larger than it actually is.
>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…
This is what happens when I try to read text in a dream.
>> A fun (but impractical and frustrating) variant of this feature is to have the image change as soon as the viewer looks away. So you’re looking at a painting, glance away to another room, and look back to find a new painting hanging on the wall. Re this comment. There is this thing called "saccadic masking", the gist of which is that we are effectively blind while our eyes move from focusing on one position to the…
Thanks for the explanation, that was great! I imagine you could play Where's Waldo without changing screens. Just "find the next Waldo" on an ever changing scenario. The moment you find one, another is created at other spot. Could be very addictive, although sounds kind of stressfull also.
It would be easier if each Waldo was looking or pointing towards the next one.
A cool effect would be to have the painting actually looking at you using face recognition. Freaky.
An excellent idea. Perhaps combined with the look away detection mentioned in the article, such that the painting only tracks you when you aren't looking directly at it. Reminiscent of many a horror movie.