Stable Diffusion animation
91–100 of 107 posts
Re: Stable Diffusion animation
#92Re: Stable Diffusion animation
#93Maybe I can shine some light on the debate from an concept artist standpoint that works in VFX and advertising. I worked on feature films (3 of them in the imdb top 100), tv shows (like game of thrones) and hundreds of AD campaigns. In the last 10 year the work of a concept artist changed dramatically we have gone from purely painted concept art to mostly "photobashed". Photobashed means basically that you rip apart…
My first thoughts when I saw DALL-E were, "Wow, I can't wait to matte paint with this!"
A texture here, something robot like here, some technical or magical doodads there. Smash them all together and even use img2img to blend things, then do the finishing touches and lighting by hand. It's so nice for speed "painting".
As a programmer, it honestly reminds me of the situation with Copilot.
Re: Stable Diffusion animation
#94Maybe I can shine some light on the debate from an concept artist standpoint that works in VFX and advertising. I worked on feature films (3 of them in the imdb top 100), tv shows (like game of thrones) and hundreds of AD campaigns. In the last 10 year the work of a concept artist changed dramatically we have gone from purely painted concept art to mostly "photobashed". Photobashed means basically that you rip apart…
I wondered if we were suffering from a collective blind spot where, for example, an outsider looking at copilot might decide that it's revolutionary for writing code where, in practice, I don't know anyone using it in anger. On the other hand artists are amazingly adept at leveraging new technology, mediums and techniques to create art so it's probably less surprising if they jump at Stable Diffusion in a lot of corn…
And FWIW, I think these tools are still a little too limited to replace even a single person. They might make someone slightly more productive, but the modern stack for both programmers and digital artists is many levels deep. Automating any one of those levels is not sufficient to replace a human. You would need to automate every slice of the stack, plus the work required to stitch those slices together.
Re: Stable Diffusion animation
#95https://twitter.com/dreamwieber/status/1565008078466326528?s...
It's a pretty magical time with this tech. Things are moving very rapidly and I feel excited the way I did when I first rendered 3d animation on my 286 from RadioShack.
Re: Stable Diffusion animation
#96Earlier quoted context omitted.
Neat. Didnt Microsoft release a tool that morphed between two photos a decade ago? I dont recall the name unfortunately, but the effect was similar, less quality.
Back in the DOS days I had (and a still do) a copy of a tool called 'Morph', it took two GIF images, and you placed marker points on the first image and then again on the second, and it generated an MPEG2 file of the morphing. Very impressive for the time.
Re: Stable Diffusion animation
#97I just came across this on twitter, every frame appears to be an evolution of the previous frame using img2img paired with a tilt/zoom to create a psychedelic animation. The author claims to have made this with Stable Diffusion, Disco, and Wiggle: https://www.youtube.com/watch?v=Nz_n0qxqoPg I believe Wiggle is used to automate the tilt/zoom between frames.
I like their earlier work more, with the audio pictograms.
Re: Stable Diffusion animation
#98I just came across this on twitter, every frame appears to be an evolution of the previous frame using img2img paired with a tilt/zoom to create a psychedelic animation. The author claims to have made this with Stable Diffusion, Disco, and Wiggle: https://www.youtube.com/watch?v=Nz_n0qxqoPg I believe Wiggle is used to automate the tilt/zoom between frames.
Re: Stable Diffusion animation
#99Andreas, author of the Replicate model here -- though "author" feels wrong since I basically just stitched two amazing models together. The thing that really strikes me is that open source ML is starting to behave like open source software. I was able to take a pretrained text-to-image model and combine it with a pretrained video frame interpolation model and the two actually fit together! I didn't have to re-train o…
Maybe that's what we were supposed to do all along. Not find or be found by aliens, but to invent them.
Re: Stable Diffusion animation
#100Earlier quoted context omitted.
Back in the DOS days I had (and a still do) a copy of a tool called 'Morph', it took two GIF images, and you placed marker points on the first image and then again on the second, and it generated an MPEG2 file of the morphing. Very impressive for the time.
I had the "DMORPH" program, which had you construct a grid, and it would generate separate image for every frame. Then you had to use "DTA" to turn it into a FLIC file. No MPEG here, no animated .gif here, you had FLIC as your animation format.