Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Hololens facial recognition prototype

github.com

Post reply on HN
Print view View original

21–30 of 30 posts

Re: Hololens facial recognition prototype

#21

Post by nl »

daeken wrote: post #5

I'm honestly astounded that this works. The color camera on the Hololens is 1280x720, making it useless for most tasks. I love this device so much, but man, such a misstep. Super neat prototype though.

The color camera on the Hololens is 1280x720, making it useless for most tasks

This seems.. somewhat extreme.

I built a (prototype) hand-tracking system using a 800x600 webcam[1]. In Javascript. Using a Flash->Javascript bridge. In 2009. I'm surprised that one can't find useful things to do with something that appears somewhat more capable.

[1] https://github.com/nlothian/FlashCamShim

Re: Hololens facial recognition prototype

#22

Post by nl »

daeken wrote: post #20
ethanbond wrote: post #11

Earlier quoted context omitted.

What "most tasks" are you referring to? Just curious since the applications of Hololens don't seem very solidified to begin with.

Well, "most tasks" here is really just the things I've wanted to do -- not exactly an unbiased sample. Things like tracking objects, reading QR codes, matching more complicated hand gestures (than the built-in ones). Unfortunately, a lot of the really interesting things that could be done involve the high-res IR cameras, which aren't exposed in any way to userspace.

Object tracking[1] and QR code reading are definitely possible at that resolution. For QR codes it's going to depend on the distance from it though.

[1] http://introlab.github.io/find-object/

Re: Hololens facial recognition prototype

#23

Post by wwwigham »

BinaryIdiot wrote: post #3

This detects a face and displays the attributes it calculated about it. That's pretty interesting though from the title I thought it was something that looked up people and displayed their name, etc. Pretty cool though ultimately it just takes the Halo Lens input, sends it to the Microsoft Face API[1] and displays its results. [1] https://www.microsoft.com/cognitive-services/en-us/face-api

It does try to identify names, actually. Looking at the source[1], once it has used the Oxford API to find where faces are in the frame (and their approx age and gender, etc), each individual face is then also queried against the MS emotion API and an OpenFace[2] instance. Given the source, it looks like that instance is meant to be trained on staff members and report their organizational hierarchy.

What would be super neat would be ripping out the OpenFace query, and replacing it with a lookup via Facebook[3], so it could actually just show the names for anyone I was FB friends with.

[1]https://github.com/UoA-eResearch/hololens_facial_recognition... [2]https://cmusatyalab.github.io/openface/ [3]https://news.ycombinator.com/item?id=11836884

Re: Hololens facial recognition prototype

#24

Post by TeMPOraL »

arcticfox wrote: post #19
pfooti wrote: post #15

Earlier quoted context omitted.

Link it to other information from my contacts as well. "Hello ... Dave. How is your ... wife ... Kelly? And your ... dog?"

Just reading those slight pauses makes me think of Black Mirror

There was a scene in Black Mirror 3x01 with exactly that situation.

Re: Hololens facial recognition prototype

#25

Post by YeGoblynQueenne »

lordnacho wrote: post #7

Perfect, I'm looking forward to a world where everyone has their name floating above their heads like in World of Warcraft. Saves you having to remember stuff.

Until then we can hopefully agree to a Universal XP and Attribute Protocol, so you can also see peoples' level and skills.

Re: Hololens facial recognition prototype

#26

Post by pavlov »

YeGoblynQueenne wrote: post #25
lordnacho wrote: post #7

Perfect, I'm looking forward to a world where everyone has their name floating above their heads like in World of Warcraft. Saves you having to remember stuff.

Until then we can hopefully agree to a Universal XP and Attribute Protocol , so you can also see peoples' level and skills.

That must be why Microsoft bought LinkedIn.

Re: Hololens facial recognition prototype

#27

Post by nojvek »

arcticfox wrote: post #19
pfooti wrote: post #15

Earlier quoted context omitted.

Link it to other information from my contacts as well. "Hello ... Dave. How is your ... wife ... Kelly? And your ... dog?"

Just reading those slight pauses makes me think of Black Mirror

And see their status score which is a result of their credit score, Facebook likes, linked in profile and Google searches.

Then you get a whole generation who is obsessed with this score and go to extremes to manipulate them.

Yeah it's going to be awesome /s

Re: Hololens facial recognition prototype

#28

Post by nojvek »

I wonder if any of the researchers evaluate the ethical decisions behind this. Right now it looks naive.

We have a president who is very anti-muslim and Pro-surveillance. What if this falls in the wrong hands? What if it classifies the wrong person?

Snapchat filters are already racist with dark color tones.

I'm arguing that widespread use of advanced facial recognition will be detrimental to society.

Re: Hololens facial recognition prototype

#30

Post by ne0nninja »

legodt wrote: post #14
oaktowner wrote: post #13

Earlier quoted context omitted.

Who on earth are you to judge what a 1.0 mustache is?

It is not my call, I defer entirely to The Machine. We can not understand its reasoning, only attempt to understand how it became what it is. Serious question on this topic though, does anybody know if this facial recognition library has been completely open sourced? Apologies if the answer is glaringly obvious or has already been answered in this thread.

https://www.microsoft.com/cognitive-services/en-us/face-api isn't open source, but https://cmusatyalab.github.io/openface/ is
Post reply on HN