Production-Level Facial Capture Using Deep Convolutional Neural Networks
research.nvidia.com
Production-Level Facial Capture Using Deep Convolutional Neural Networks
1–10 of 14 posts
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#2This is really awesome,this will stimulate the movie industry.
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#3Fantastic! Thanks for another amazing Deep Learning paper to study and play with!
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#4Fantastic! Thanks for another amazing Deep Learning paper to study and play with!
how can you play with this without any data?
"The training data used for the deep neural network was generated using Remedy Entertainment’s in-house capture pipeline based on a cutting edge commercial DI4D PRO system [Dimensional Imaging 2016] that employs nine video cameras."
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#5Fantastic! Thanks for another amazing Deep Learning paper to study and play with!
how can you play with this without any data? "The training data used for the deep neural network was generated using Remedy Entertainment’s in-house capture pipeline based on a cutting edge commercial DI4D PRO system [Dimensional Imaging 2016] that employs nine video cameras."
You can always take tested ideas and apply to your own rig. The pioneering work was done by NVidia already, you see the results and it's up to you how much inspiration can you take from their work.
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#6We see a similar realtime application in snapchat[1] -- probably not as detailed as this one but might be a similar tech,
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#7We see a similar realtime application in snapchat[1] -- probably not as detailed as this one but might be a similar tech, 1. https://techcrunch.com/2015/09/15/snapchat-looksery/
I don't think there's any mention of NN to create those filters - in fact, not sure if it's ML at all. Very likely some off-the-shelf CV face-detection - especially considering it must run real-time on a phone.
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#8Fantastic! Thanks for another amazing Deep Learning paper to study and play with!
how can you play with this without any data? "The training data used for the deep neural network was generated using Remedy Entertainment’s in-house capture pipeline based on a cutting edge commercial DI4D PRO system [Dimensional Imaging 2016] that employs nine video cameras."
There are lots of sources for mocap data if you know people in the film, games, or entertainment industry.
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#9We see a similar realtime application in snapchat[1] -- probably not as detailed as this one but might be a similar tech, 1. https://techcrunch.com/2015/09/15/snapchat-looksery/
I don't think there's any mention of NN to create those filters - in fact, not sure if it's ML at all. Very likely some off-the-shelf CV face-detection - especially considering it must run real-time on a phone.
You can trivially detect facial features using Deep Learning/CNN on a phone real-time.
Re: Production-Level Facial Capture Using Deep Convolutional Neural Networks
#10We see a similar realtime application in snapchat[1] -- probably not as detailed as this one but might be a similar tech, 1. https://techcrunch.com/2015/09/15/snapchat-looksery/
I don't think there's any mention of NN to create those filters - in fact, not sure if it's ML at all. Very likely some off-the-shelf CV face-detection - especially considering it must run real-time on a phone.
Even the "simplest" face detection algorithms rely on strong machine learning concepts, eg: Viola-Jones uses AdaBoost to train the face classifier cascade.