Live data from Hacker News

Glasses-free 3D using webcam head tracking

assetstore.unity.com

31–40 of 110 posts

Re: Glasses-free 3D using webcam head tracking

#31
How is this different from the many available head tracking devices? I used to play Flight Simulator with head tracking[1]. It was great, although it did consume a bit of CPU cycles. IR trackers are more efficient

[1] - https://www.youtube.com/watch?v=P07nIcczles (actually, this one was using a paper tracker because the face tracker had a big impact on fps)

Re: Glasses-free 3D using webcam head tracking

#33
post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

definitely laggy, but works even under low lighting conditions and a camera that is not facing straight forward.

Re: Glasses-free 3D using webcam head tracking

#34

BTW, the OG demo from Johnny Lee is from 2007: https://www.youtube.com/watch?v=Jd3-eiid-Uw

Came here to say the same. I remember playing around with this back in the day, but using two candles instead of the sensor bar. Yes, it works. No, it’s not a good idea to hold candles that close to your hair.

Re: Glasses-free 3D using webcam head tracking

#35

> This content is hosted by a third party provider that does not allow video views without acceptance of Targeting Cookies. Please set your cookie preferences for Targeting Cookies to yes if you wish to view videos from these providers. OK, that's a no then.

It's YouTube. This is super common, just worded in a weird way.

It's also incorrect. They could just use youtube-nocookie.com instead if tracking cookies are disabled. https://support.google.com/youtube/answer/171780?hl=en#zippy...

Re: Glasses-free 3D using webcam head tracking

#36
post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

The obvious use case would be to replace the clunky head tracking systems which are often used in simulator games. Systems like trackir, which require dedicated hardware.

You can do this today with OpenTrack: https://github.com/opentrack/opentrack

Also, TrackIR is just an IR webcam, IR leds, and a hat with reflectors. You can DIY the exact same setup easily with OpenTrack, but OpenTrack also has a neural net webcam-only tracker which is, AFAIK, pretty much state of the art. At any rate it works incredibly robustly.

Actually I have already used it to implement the same idea as the post, with the added feature of anaglyph (red/blue) glasses 3D. The way I did it, I put an entire lightfield into a texture and rendered it with a shader. Then I just piped the output of OpenTrack directly into the shader and Robert, c'est votre proverbial oncle. The latency isn't quite up to VR standard (the old term for this is "fishtank VR"), but it's still quite convincing if you don't move your head too fast.

Re: Glasses-free 3D using webcam head tracking

#37
post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

The obvious use case would be to replace the clunky head tracking systems which are often used in simulator games. Systems like trackir, which require dedicated hardware.

Trackir is just a camera with an infrared led.

Re: Glasses-free 3D using webcam head tracking

#39
post #2

Hi HN, I'm Sten, one of the creators. We built this because we wanted 3D experiences without needing a VR headset. The approach: use your webcam to track where you're looking, and adjust the 3D perspective to match. Demo: https://portality.io/dragoncourtyard/ (Allow camera, move your head left/right) It creates motion parallax - the same depth cue your brain uses when you look around a real object. Feels like looking…

It was definitely useful and appreciated on the "New" Nintendo 3DS XL, which also used a camera to track your eye movements and adjust the divergence accordingly. I hate the fact that Nintendo abandoned this technology because experiencing Ocarina of Time and Star Fox 64 in 3D was world-changing to me. I'd say I'm not the only one who misses this technology in games, because a used New 3DS XL costs at least $200 on e…

Vr has taken over this market. Get a vr headset you won't be disappointed.

Re: Glasses-free 3D using webcam head tracking

#40

BTW, the OG demo from Johnny Lee is from 2007: https://www.youtube.com/watch?v=Jd3-eiid-Uw

I tried implementing this with face detection-based head tracking after that demo (or maybe before; I can't remember). I got it working but the effect was very underwhelming. It looks great in that video, but it kind of sucks in real life.

I think the problem is in real life you have an enormous number of other visual cues that tell you that you're not really seeing something 3D - focus, stereoscopy (not for me though sadly), the fact that you know you're looking at the screen, inevitable lag from cameras, etc.

I can't view the videos because of their stupid cookie screen, but I wouldn't be too excited about this. The camera lag especially probably impossible to solve.

Post reply on HN