High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#1

Post by bukka » Fri, Jan 31, 2025, 4:37 PM UTC

High-Speed Face-Tracking for Dynamic Facial Projection Mapping
vision.ict.e.titech.ac.jp

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#2

Post by bhouston » Mon, Feb 03, 2025, 11:33 AM UTC

Neat stuff. I wonder if one could use a neural network to try to do prediction as well.

Human movements are super stereotyped in the face and you could likely predict with decent accuracy the next frame given the previous frames.

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#3

Post by _flux » Mon, Feb 03, 2025, 11:45 AM UTC

Pretty cool. I've had this idea of converting face data into MIDI CC data to use with DAWs or synths, this could be a useful algorithm for it.

Is the source code available?

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#4

Post by croes » Mon, Feb 03, 2025, 1:43 PM UTC

> to create immersive experiences that have been used in the makeup and entertainment industries.

Or for fake propaganda videos. Dangerous time for these kinds of progress.

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#5

Post by xfeeefeee » Mon, Feb 03, 2025, 1:51 PM UTC

The artistic possibilities of this are really fascinating. Looking forward to what people come up with! Projection mapping interactive art is always mesmerizing

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#6

Post by Hugsun » Mon, Feb 03, 2025, 2:22 PM UTC

croes wrote: post #4

> to create immersive experiences that have been used in the makeup and entertainment industries. Or for fake propaganda videos. Dangerous time for these kinds of progress.

What sort of propaganda do you forsee this enabling?

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#7

Post by croes » Mon, Feb 03, 2025, 2:31 PM UTC

Hugsun wrote: post #6

croes wrote: post #4

> to create immersive experiences that have been used in the makeup and entertainment industries. Or for fake propaganda videos. Dangerous time for these kinds of progress.

What sort of propaganda do you forsee this enabling?

„Leaked“ videos of political enemies saying abysmal things

The Protocols of the Elders of Zion on steroids.

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#8

Post by grayhatter » Mon, Feb 03, 2025, 2:41 PM UTC

croes wrote: post #7

Hugsun wrote: post #6

Earlier quoted context omitted.

What sort of propaganda do you forsee this enabling?

„Leaked“ videos of political enemies saying abysmal things The Protocols of the Elders of Zion on steroids.

Uh... this is a white paper about projecting an image onto a moving face. Not super imposing, but projecting... with a projector... using light... so what exactly are you worried about with this tech? Or is it just that you're afraid of face tracking in general? And it's not really about this topic specifically?

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#9

Post by addandsubtract » Mon, Feb 03, 2025, 2:41 PM UTC

What is the SotA OSS for face tracking these days? I've never been able to make face tracking work without having alignment issues during movement.

Re: High-Speed Face-Tracking for Dynamic Facial Projection Mapping

#10

Post by bj-rn » Mon, Feb 03, 2025, 3:18 PM UTC

xfeeefeee wrote: post #5

The artistic possibilities of this are really fascinating. Looking forward to what people come up with! Projection mapping interactive art is always mesmerizing

This (older) collab is pretty nice: https://www.vision.ict.e.titech.ac.jp/projects/WOW_TOKYO_AYA...