Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

High-Speed Face-Tracking for Dynamic Facial Projection Mapping

vision.ict.e.titech.ac.jp

Post reply on HN
Print view View original

21–24 of 24 posts

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#21

Post by HanayamaTriplet »

croes wrote: post #13
grayhatter wrote: post #8

Earlier quoted context omitted.

Uh... this is a white paper about projecting an image onto a moving face. Not super imposing, but projecting... with a projector... using light... so what exactly are you worried about with this tech? Or is it just that you're afraid of face tracking in general? And it's not really about this topic specifically?

It’s about high speed face tracking. Can you imagine other use cases than projection?

You don't need high speed face tracking to make video edits, those are not going to be done in real time.

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#22

Post by grayhatter »

croes wrote: post #20
grayhatter wrote: post #18

Earlier quoted context omitted.

> Can you imagine other use cases than projection? yes vtubers human interface device for quadriplegics automated camera tracking/zoom for video calls emotion recognition support software for people with difficulty reading or understanding emotions (ASD) truly smart, smart home that can track and respond to gaze, e.g. "can you turn off that light" and it will turn off the light they're looking at sleep detection for…

Yes, list the malicious ones too.

impersonation?

are there others?

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#24

Post by zipy124 »

addandsubtract wrote: post #9

What is the SotA OSS for face tracking these days? I've never been able to make face tracking work without having alignment issues during movement.

I don't know if it's SoTa but previously in a joint academic+industrial project I've had very good success with faceboxes for face tracking and then adaptive Wing loss for facial alignment. With c++ and an ONNX runtime, I achieved very fast and accurate results, being robust to lighting and harsh angles.

https://github.com/protossw512/AdaptiveWingLoss

https://github.com/sfzhang15/FaceBoxes

Post reply on HN