Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Microsoft demos 'holoportation' 3D presence tech with HoloLens

research.microsoft.com

Post reply on HN
Print view View original

31–40 of 117 posts

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#31

Post by lhl »

cududa wrote: post #7
sigmar wrote: post #5

Pretty cool, but my first thought is: how authentic will communication be when "holoporting" to each other if you both have those big hololens mounted on your head? It will be hard to pick up on each other's facial expressions and impossible to look into each other's eyes.

In a generation or two they'll do facial tracking. I imagine you'll get a full 3D model made of you, and it'll pick up the facial movements and transpose them onto your avatar

Here's an example of Faceshift, which is completely markerless (Apple acquired them last year): https://www.youtube.com/watch?v=RLfAmNDNgHk

And here's a good example of the relatively high fidelity (marker-based) tracking that's happening in real-time: https://www.youtube.com/watch?v=OdQpJgLs51w

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#32

Post by DanAndersen »

This is pretty exciting because of its potential for telementoring. I've been working on a research project using tablets and augmented reality for surgical telementoring in austere environments ( https://engineering.purdue.edu/starproj/ ), but a setup like what MS has here would offer so many benefits. Imagine a trainee surgeon being able to feel as if a mentor surgeon was actually present and able to gesture and give instruction during the course of a live surgery, for example.

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#34

Post by cb18 »

How do they define which aspects of the captured image to extract, model, and transmit? If they were just modeling the humans, I could seeing using motion detection, or infrared perhaps, but they seem to have also extracted and modeled the little girl's toys.

So i'm curious what method they use to extract just specific bits of the image captured in the holodeck. Perhaps this is answered in one of their papers.

If anyone knows and has a quick overview, or link to a relevant paper that'd be great.

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#35

Post by miguelrochefort »

cb18 wrote: post #34

How do they define which aspects of the captured image to extract, model, and transmit? If they were just modeling the humans, I could seeing using motion detection, or infrared perhaps, but they seem to have also extracted and modeled the little girl's toys. So i'm curious what method they use to extract just specific bits of the image captured in the holodeck. Perhaps this is answered in one of their papers. If any…

The setups are identical, so it seems obvious that they capture everything that differs (i.e., not part of the floor and cubes).

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#38

Post by JabavuAdams »

dominotw wrote: post #25
hanniabu wrote: post #2

I was waiting for this, knew it was only a matter of time before Microsoft came out with something like this since it's right in their field of office products. Hopefully this is the catalyst needed to create better work/life balance and lower the barrier for remote work and make it just as productive as being present in the office.

For remote work, what are the advantages of this over a good video conferencing/screen sharing type of setup.

Field of view and peripheral vision?

Re: Microsoft demos 'holoportation' 3D presence tech with HoloLens

#40

Post by AndrewKemendo »

hoodoof wrote: post #37

Microsoft seems to be fiddling around in research while Sony runs away with the Virtual Reality cup.

As a point of clarification, this is Augmented Reality, which is actually quite different than Virtual Reality in practice and scale.

So it's an apples to bananas comparison.

Post reply on HN