I'm glad things are progressing, but it bugs me that AI is largely being innovated for the use of... things like this? I know this comment is a bit disparaging and minimizes greater achievements, and I apologize for that, but the closeness of content-consumerism and AI is becoming quite off putting.
VToonify: Controllable high-resolution portrait video style transfer
21–23 of 23 posts
Re: VToonify: Controllable high-resolution portrait video style transfer
#22Based on the numbers in the paper this is just a little bit too slow for use as a real time video effect. At ~0.1 seconds per frame we just need about a 3x improvement in performance to get to 30fps “real time” video frame rates. And on that thought since it appears they used nVidia hardware based on the CUDA dependency, it would be interesting to see how this performs on something like an M1/M2 where there’s dedicat…
Sure, but that’s not too far from the 12fps that cartoon animators often actually use.
Re: VToonify: Controllable high-resolution portrait video style transfer
#23Based on the numbers in the paper this is just a little bit too slow for use as a real time video effect. At ~0.1 seconds per frame we just need about a 3x improvement in performance to get to 30fps “real time” video frame rates. And on that thought since it appears they used nVidia hardware based on the CUDA dependency, it would be interesting to see how this performs on something like an M1/M2 where there’s dedicat…
Sure, but that’s not too far from the 12fps that cartoon animators often actually use.
That’s a good point. I did briefly think about 24fps for “cinema” but as that’s a bit of a weird frame rate for a streaming webcam I dismissed the idea. But the video does actually have just enough frame rate to look smooth and I suppose that’s because it’s landing near enough to 12fps that combined with “looks like cartoon”, my brain is filing in the rest and barely noticing.