Stable Diffusion animation
replicate.com
Stable Diffusion animation
1–10 of 107 posts
Re: Stable Diffusion animation
#2In this example, 25 frames are generated using Stable Diffusion, then frames are interpolated using FILM-Net. I hadn't see FILM-net before, it looks really neat.
Re: Stable Diffusion animation
#3I feel like I’m watching an explosion of progress in AI image generation in real-time.
Every day there’s a new application of Stable Diffusion. It’s incredible to watch unfold
Re: Stable Diffusion animation
#4[deleted]
Re: Stable Diffusion animation
#5In this example, 25 frames are generated using Stable Diffusion, then frames are interpolated using FILM-Net. I hadn't see FILM-net before, it looks really neat.
This? Looks pretty amazing:
Re: Stable Diffusion animation
#6I feel like I’m watching an explosion of progress in AI image generation in real-time. Every day there’s a new application of Stable Diffusion. It’s incredible to watch unfold
I think it's pretty notable how most of the explosion happened since stable diffusion released their model and code as open source, while Dall-E generated initial excitement with their closed source model, but limited progress / creativity since. It's a pretty nice demonstration I think of how much innovation can happen from openness.
Re: Stable Diffusion animation
#7I just came across this on twitter, every frame appears to be an evolution of the previous frame using img2img paired with a tilt/zoom to create a psychedelic animation.
The author claims to have made this with Stable Diffusion, Disco, and Wiggle: https://www.youtube.com/watch?v=Nz_n0qxqoPg
I believe Wiggle is used to automate the tilt/zoom between frames.
Re: Stable Diffusion animation
#8In this example, 25 frames are generated using Stable Diffusion, then frames are interpolated using FILM-Net. I hadn't see FILM-net before, it looks really neat.
Neat. Didnt Microsoft release a tool that morphed between two photos a decade ago? I dont recall the name unfortunately, but the effect was similar, less quality.
Re: Stable Diffusion animation
#9Re: Stable Diffusion animation
#10AI in animation has been interesting to me for a while now. It leaves me a little conflicted though. If we get to the point where we can throw key drawings at AI and let it handle all the inbewteens without a bunch of tweaking and cleanup afterwards it's going to really suck for places like Korea! I guess all those inbeatweeners will just be another victim of automation.
I've always loved animation, but I'll admit part of that comes from the hubris involved. It's pure insanity that people ever drew, by hand, mountains of individual drawings each slightly changed and assembled them into compelling illusions to tell stories. The amount of work that goes into animation is just staggering and anyone sensible would have rejected the entire concept as absurd. I wonder if animation will start losing part of its magic for me when it's done primarily by AI.
On the other hand though, another thing I've always loved about animation as a storytelling medium is that it isn't as limited by practical concerns like physics or reality. If something can be imagined, it can be drawn and animated if somebody has the skill and the resources to fund the massive amounts of work. It's time/money that forces animators to take shortcuts and make compromises. Creative decisions are made and rejected all the time due to those constraints. If AI driven animation gets more advanced to the point where that's no longer such a barrier it could create output more in line with the vision of creators and that's exciting too!
I hope that traditional hand drawn animation never dies, but I look forward to seeing how AI continues to change the industry and the output.