Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

inflightassistant.com

Post reply on HN
Print view View original

1–10 of 20 posts

Re: Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

#2

Post by epaga »

This has been a fun project - moving the camera around in games like Flight Simulator simply by slightly moving your head is really immersive. Not quite VR, but good enough! Happy to answer any questions.

(Coming soon - a version that will run without a TrueDepth camera.)

Re: Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

#4

Post by jasonpeacock »

I'm sure I'm missing something as I have no experience with these tools/software....

When you turn your head to the right, the screen in front of you shows the view to the right but now you're facing to the right and you can't see the screen in front of you anymore?

How do you setup your battlestation to best use this?

Re: Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

#5

Post by evan_ »

jasonpeacock wrote: post #4

I'm sure I'm missing something as I have no experience with these tools/software.... When you turn your head to the right, the screen in front of you shows the view to the right but now you're facing to the right and you can't see the screen in front of you anymore? How do you setup your battlestation to best use this?

I was wondering this as well. In the video he turns his head about 20° or 30° and the view shifts almost 90°, so it must amplify his motions? I suppose you would get used to that pretty quickly.

Re: Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

#6

Post by rspicer »

evan_ wrote: post #5
jasonpeacock wrote: post #4

I'm sure I'm missing something as I have no experience with these tools/software.... When you turn your head to the right, the screen in front of you shows the view to the right but now you're facing to the right and you can't see the screen in front of you anymore? How do you setup your battlestation to best use this?

I was wondering this as well. In the video he turns his head about 20° or 30° and the view shifts almost 90°, so it must amplify his motions? I suppose you would get used to that pretty quickly.

Yes. OpenTrack has user-editable Bézier curves that map real-world translation and rotation to what’s output to the game.

This is an awesome hack and I wish I’d thought of it.

Re: Show HN: Seamless head tracking for games using the TrueDepth camera (iOS)

#9

Post by ChicagoBoy11 »

epaga wrote: post #2

This has been a fun project - moving the camera around in games like Flight Simulator simply by slightly moving your head is really immersive. Not quite VR, but good enough! Happy to answer any questions. (Coming soon - a version that will run without a TrueDepth camera.)

I love projects like this. It's such an elegant and in hindsight immediately obvious solution that it definitely stops you in your tracks. Will try it this weekend with FS2020; certainly a good stop-gap until they implement native VR.

Can you perhaps elaborate a bit on what the process was like getting some of that info through the iOS APIs and then exposing it through UDP for the PC? Any interesting snags you hit along the way?

Post reply on HN