Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Glasses-free 3D using webcam head tracking

assetstore.unity.com

Post reply on HN
Print view View original

91–100 of 110 posts

Re: Glasses-free 3D using webcam head tracking

#91

Post by il_nets »

utopcell wrote: post #33
il_nets wrote: post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

definitely laggy, but works even under low lighting conditions and a camera that is not facing straight forward.

May I ask what device and browser you are using?

Re: Glasses-free 3D using webcam head tracking

#92

Post by il_nets »

toss1 wrote: post #42
il_nets wrote: post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

Very cool! I can see this quite useful for educational demonstrations of physics situations and mechanical systems (complex gearing, etc.). Also maybe for product simulations/demonstrations in the design phase — take output from CAD files and make a nice little 3D demo. Maybe have an "inertia(?)" setting that makes it keep turning when you move far enough off center, as if you were continuing to walk around it. The s…

Good ideas - we've considered these as well actually!

The intertia-idea wouldn't be too difficult to implement, but its usefulness would probably depend on the application area.

Yep exactly. Usually it locks onto one person's face but it can also jump around, so there are still optimizations we can do there - but generally it's supposed to be for one person. If you compare to VR headsets, two people can't wear the same VR headset anyway!

Re: Glasses-free 3D using webcam head tracking

#93

Post by anfractuosity »

smashah wrote: post #67
peterept wrote: post #66

I got excited about this a few years ago when I was into digital pinball. I built an open source project called Phonemote using an iPhone to track eyes and relay telemetry over WiFi/BT and a plugin for FuturePinball. However the result wasn’t that useful because we humans have 2 eyes. The 3d effect is very compelling if you close/cover one eye. But that becomes annoying quickly. The best results I had was sneering a…

There is a taiwanese company that has developed a sandwiched lenticular screen protector for phones that should fix this. Looks amazing in my opinion. You should try it out with your project.

Do you have a link to that, sounds cool?

Re: Glasses-free 3D using webcam head tracking

#94

Post by asadm »

RHSeeger wrote: post #69
asadm wrote: post #64

Earlier quoted context omitted.

this (and several of his ideas) were the reason I value simple solutions so much in my work along with optimising for low cost. "If Johnny Lee can do this crazy thing in cheap, I can think something creative too"

Have you seen the video of the guy who built a camera to film light moving in super slowmo? The things people build amaze me.

yes agreed! very inspiring.

Re: Glasses-free 3D using webcam head tracking

#95

Post by Wowfunhappy »

il_nets wrote: post #78
Wowfunhappy wrote: post #51

Earlier quoted context omitted.

The 3DS is different, it's using a lenticular screen so your eyes actually see different images! The eye tracking allows it to work even if the position of your eyes changes (ie because you moved your head). Presumably developers could have combined this with parallax head tracking for an even stronger effect when you move your head (or the console), but as far as I know no one did.

Do you mean combining the eye tracking with using a lenticular screen? What would do you think the use cases would/could be?

Well, there are two different ways (among others) that your brain detects depth:

1. Each eye sees the object from a different angle.

2. Both eyes see the object from a different angle when the object is moved relative to your head.

The 3DS does only #1. TFA does only #2. Presumably if you did both, you could get a much stronger effect.

I think the New 3DS had the hardware to do both in theory, but it probably would have made development and backwards compatibility overly complicated!

Re: Glasses-free 3D using webcam head tracking

#96

Post by RHSeeger »

il_nets wrote: post #88
RHSeeger wrote: post #69

Earlier quoted context omitted.

Have you seen the video of the guy who built a camera to film light moving in super slowmo? The things people build amaze me.

Do you have a link?

https://www.youtube.com/watch?v=o4TdHrMi6do

Well worth taking a look at

Re: Glasses-free 3D using webcam head tracking

#97

Post by arnarbi »

il_nets wrote: post #81
arnarbi wrote: post #72

Earlier quoted context omitted.

Back in college (~2008) we implemented this with a 7 foot tall back-projected screen and a couple of Wii remotes after seeing Johnny Lee’s video. The nice thing with that screen was that you could stand so close to it you couldn’t really see the edges. We had as many people come test as we could, and we found that 90% of them didn’t get a sense of depth, likely because it lacked stereo-vision cues. It only worked for…

That's interesting! Did you continue play around with it and take it further?

We did not, no. Just wrote up the report and moved on.
Post reply on HN