Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Augmented Reality 3d Video on iPad with Kinect

youtube.com

Post reply on HN
Print view View original

11–16 of 16 posts

Re: Augmented Reality 3d Video on iPad with Kinect

#11

Post by rkalla »

KingOfB wrote: post #5

Here's the launch video for String SDK. Looks pretty impressive, much smoother than many other implementations I've seen http://www.poweredbystring.com/official-launch Great demo video about 1:30 in to the launch video.

It's hard to tell how it performs in real life (not a launch video) but that being said the demos of it in action were impressive.

I wonder if this is the form the Holodeck/3D technology we've all been waiting for since the 70s will be in.

AR of your living room mixed with a glassesless 3D TV[1] and some motion controls. Very exciting stuff.

[1] http://3dradar.techradar.com/3d-tech/52-inch-glasses-free-3d...

Re: Augmented Reality 3d Video on iPad with Kinect

#12

Post by hammerdr »

rkalla wrote: post #10
hammerdr wrote: post #8

Earlier quoted context omitted.

I have no video, but I was able to get a WebGL-powered game world running that was controlled through a Kinect using DepthJS. This was done in just over a day of playing around. Was pretty cool when it worked. The source code is available on github at https://github.com/thoughtworks/kinect-spike Edit: My co-workers were looking at me with concerned looks that day. I would stand up and wave my arms for 30 seconds and…

Very impressive Derek -- how easy was it to work with the Kinect data via the API? Is the information coming out of the sensors pretty straight forward or does it just come in as a video feed with additional metadata (positional?)

The way that DepthJS works is through three technologies: libfreenect[1], OpenCV[2] and then a simple Tornado (push) server. libfreenect is what grabs all of the data from the Kinect device and OpenCV is the 'interpreter'. This translates to just getting events such as 'move' in the browser.

[1] http://openkinect.org/wiki/Main_Page

[2] http://opencv.willowgarage.com/wiki/

Re: Augmented Reality 3d Video on iPad with Kinect

#13

Post by nitrogen »

rkalla wrote: post #2

So damn clever... releasing an SDK for the Kinect[1] was one of the smartest things Microsoft could have ever done and I think has gone a long way to contribute to it being the fastest selling piece of hardware in history[2] (did anyone know that? I sure didn't, and barely believed it reading it). This reminds me a lot of what Johnny Lee did with the Wii soon after it was released with head-tracking 3D[3] Part of me…

What I find cool is that this sort of application (3D video recording) is actually possible with libfreenect. I bet the most difficult part was defining a storage format and getting it integrated into an app built with the augmented reality SDK.

[Added in edit:]

Anyone on HN actively toying with a Kinect and want to share some video?

Something I'm doing with libfreenect: http://nitrogen.posterous.com/gesture-like-light-control-wit...

Re: Augmented Reality 3d Video on iPad with Kinect

#15

Post by barefoot »

rkalla wrote: post #2

So damn clever... releasing an SDK for the Kinect[1] was one of the smartest things Microsoft could have ever done and I think has gone a long way to contribute to it being the fastest selling piece of hardware in history[2] (did anyone know that? I sure didn't, and barely believed it reading it). This reminds me a lot of what Johnny Lee did with the Wii soon after it was released with head-tracking 3D[3] Part of me…

I put together a very basic Kinect controlled lighting app for fun using ManagedNite:

http://www.youtube.com/watch?v=CF4mzdYo3VY

Re: Augmented Reality 3d Video on iPad with Kinect

#16

Post by barefoot »

nitrogen wrote: post #13
rkalla wrote: post #2

So damn clever... releasing an SDK for the Kinect[1] was one of the smartest things Microsoft could have ever done and I think has gone a long way to contribute to it being the fastest selling piece of hardware in history[2] (did anyone know that? I sure didn't, and barely believed it reading it). This reminds me a lot of what Johnny Lee did with the Wii soon after it was released with head-tracking 3D[3] Part of me…

What I find cool is that this sort of application (3D video recording) is actually possible with libfreenect. I bet the most difficult part was defining a storage format and getting it integrated into an app built with the augmented reality SDK. [Added in edit:] Anyone on HN actively toying with a Kinect and want to share some video? Something I'm doing with libfreenect: http://nitrogen.posterous.com/gesture-like-lig…

Looks like you and I have toyed with the same idea (Kinect controlled lighting). I was shocked by how easy it was to put together and how effective it was. Probably not an easy thing to commercialize though ("yeah, just embed these sensors in your walls and replace all of your light switches...").
Post reply on HN