31–40 of 85 posts
Very fun. Is there something like this but which can capture the motion from a webcam (without separate motion capture process as described in the readme) and project that onto the drawings?
It's a bit buried in the repo readme files, but the author @hjessmith used Rokoko Video [1] to create the animation files (BVH) from a phone video. Then he used Animated Drawings to make the drawings replicate his motion captured from the video.
Both Rokoko and Animated Drawings were new to me. I know what I'll be doing with my kids all weekend! Thanks for sharing the project.
This is amazing! It's a bit buried in the repo readme files, but the author @hjessmith used Rokoko Video [1] to create the animation files (BVH) from a phone video. Then he used Animated Drawings to make the drawings replicate his motion captured from the video. Both Rokoko and Animated Drawings were new to me. I know what I'll be doing with my kids all weekend! Thanks for sharing the project. [1] https://www.rokoko.…
Hey! That’s my project! Code and dataset are here: https://github.com/facebookresearch/AnimatedDrawings And a browser-based version of it is here: http://sketch.metademolab.com/
One thing with the browser version, it all works fine up until the animation and then its flipping my image upside down? Could this just be the photo metadata rotation/orientation??
Hey! That’s my project! Code and dataset are here: https://github.com/facebookresearch/AnimatedDrawings And a browser-based version of it is here: http://sketch.metademolab.com/
This is AMAZING, my 3 year old draws the cutest pictures and I can animate them! One thing with the browser version, it all works fine up until the animation and then its flipping my image upside down? Could this just be the photo metadata rotation/orientation??
I’m guessing that the nose key point is located below the shoulders in your child’s drawing?
That’s a known issue caused by how we ‘apply’ poses onto the characters. It’s fixed in the GitHub code but not in the browser version. Try moving the nose keypoint to the top of the characters head and that should resolve it
I want to animate video game characters with as much automation as possible because hand drawing frame-by-frame takes forever and ever. Is this my best bet?
Currently it only allows for animating a character generated from a prompt. However, we’re working to use null text inversion [0] combined with inverse DDIM (used for pix2pix) to allow animating a pre-drawn character.
Earlier quoted context omitted.
This is AMAZING, my 3 year old draws the cutest pictures and I can animate them! One thing with the browser version, it all works fine up until the animation and then its flipping my image upside down? Could this just be the photo metadata rotation/orientation??
It’s not metadata, you would see that when you upload the photo at the beginning. I’m guessing that the nose key point is located below the shoulders in your child’s drawing? That’s a known issue caused by how we ‘apply’ poses onto the characters. It’s fixed in the GitHub code but not in the browser version. Try moving the nose keypoint to the top of the characters head and that should resolve it
Earlier quoted context omitted.
Get them one of these. They'll actually get the experience pf animating, broken down into bare terms... https://the80sand90s.com/articles/etch-a-sketch-animator that little toy I had as a kid did more to shape my career as than even hypercard. FTA (and relevant): > What truly made this the best toy ever made was the amount of patience and perseverance a kid needed to create these animations, just like real animators.…
Holy crap - I totally forgot that I had one of those and spent an obscene number of hours creating on it. Thanks for the memory-blast post!
This is amazing! It's a bit buried in the repo readme files, but the author @hjessmith used Rokoko Video [1] to create the animation files (BVH) from a phone video. Then he used Animated Drawings to make the drawings replicate his motion captured from the video. Both Rokoko and Animated Drawings were new to me. I know what I'll be doing with my kids all weekend! Thanks for sharing the project. [1] https://www.rokoko.…
Rokoko Video wasn't very reliable (at one point I was standing perfectly still, but it thought I was on one leg twirling like a ballerina). Although it's very expensive, DeepMotion has been great (also if you were disappointed by DeepMotion 12+ months ago like I was, I'd suggest revisiting - it's leaps and bounds ahead of the earlier version I tried out).
move.ai looks very good too, but needs multiple cameras which was overkill for my use case. Plask seems to have regressed (the platform seems like it doesn't even work half the time) and Radical's aggressive tactics really turned me off.