Live data from Hacker News

Stable Diffusion animation

replicate.com

91–100 of 107 posts

Re: Stable Diffusion animation

#93

Maybe I can shine some light on the debate from an concept artist standpoint that works in VFX and advertising. I worked on feature films (3 of them in the imdb top 100), tv shows (like game of thrones) and hundreds of AD campaigns. In the last 10 year the work of a concept artist changed dramatically we have gone from purely painted concept art to mostly "photobashed". Photobashed means basically that you rip apart…

100% agreed!

My first thoughts when I saw DALL-E were, "Wow, I can't wait to matte paint with this!"

A texture here, something robot like here, some technical or magical doodads there. Smash them all together and even use img2img to blend things, then do the finishing touches and lighting by hand. It's so nice for speed "painting".

As a programmer, it honestly reminds me of the situation with Copilot.

Re: Stable Diffusion animation

#94

Maybe I can shine some light on the debate from an concept artist standpoint that works in VFX and advertising. I worked on feature films (3 of them in the imdb top 100), tv shows (like game of thrones) and hundreds of AD campaigns. In the last 10 year the work of a concept artist changed dramatically we have gone from purely painted concept art to mostly "photobashed". Photobashed means basically that you rip apart…

I wondered if we were suffering from a collective blind spot where, for example, an outsider looking at copilot might decide that it's revolutionary for writing code where, in practice, I don't know anyone using it in anger. On the other hand artists are amazingly adept at leveraging new technology, mediums and techniques to create art so it's probably less surprising if they jump at Stable Diffusion in a lot of corn…

Almost certainly, in the near term, these tools are going to make folks a little more productive and will not be replacing anyones job. Every digital product, whether it be SAAS software, games, or whatever, is heavily constrained by labor availability. Show me one product that was feature complete and exactly matched the scope and scale of the original vision, and I will show you 100's that needed to prioritize features and downsize scope in order to deliver in a timely manner.

And FWIW, I think these tools are still a little too limited to replace even a single person. They might make someone slightly more productive, but the modern stack for both programmers and digital artists is many levels deep. Automating any one of those levels is not sufficient to replace a human. You would need to automate every slice of the stack, plus the work required to stitch those slices together.

Re: Stable Diffusion animation

#95
I've been playing around w/ StableDiffusion animation using the "deforum" notebook. It's taken a bit to really understand how to get results I like with it, but I'm super happy with how this one came out:

https://twitter.com/dreamwieber/status/1565008078466326528?s...

It's a pretty magical time with this tech. Things are moving very rapidly and I feel excited the way I did when I first rendered 3d animation on my 286 from RadioShack.

Re: Stable Diffusion animation

#96
post #16
post #8

Earlier quoted context omitted.

Neat. Didnt Microsoft release a tool that morphed between two photos a decade ago? I dont recall the name unfortunately, but the effect was similar, less quality.

Back in the DOS days I had (and a still do) a copy of a tool called 'Morph', it took two GIF images, and you placed marker points on the first image and then again on the second, and it generated an MPEG2 file of the morphing. Very impressive for the time.

I had the "DMORPH" program, which had you construct a grid, and it would generate separate image for every frame. Then you had to use "DTA" to turn it into a FLIC file. No MPEG here, no animated .gif here, you had FLIC as your animation format.

Re: Stable Diffusion animation

#97

I just came across this on twitter, every frame appears to be an evolution of the previous frame using img2img paired with a tilt/zoom to create a psychedelic animation. The author claims to have made this with Stable Diffusion, Disco, and Wiggle: https://www.youtube.com/watch?v=Nz_n0qxqoPg I believe Wiggle is used to automate the tilt/zoom between frames.

I like their earlier work more, with the audio pictograms.

[deleted]

Re: Stable Diffusion animation

#98

I just came across this on twitter, every frame appears to be an evolution of the previous frame using img2img paired with a tilt/zoom to create a psychedelic animation. The author claims to have made this with Stable Diffusion, Disco, and Wiggle: https://www.youtube.com/watch?v=Nz_n0qxqoPg I believe Wiggle is used to automate the tilt/zoom between frames.

Reminds me of Electric Sheep[1] - I can't wait until someone hooks up news stories to have abstract news as a screensaver! Also reminds me of a time lapse of someone painting - like [2]

[1]: https://electricsheep.org/

[2]: https://www.youtube.com/watch?v=2O4ccHgfcl8

Re: Stable Diffusion animation

#99

Andreas, author of the Replicate model here -- though "author" feels wrong since I basically just stitched two amazing models together. The thing that really strikes me is that open source ML is starting to behave like open source software. I was able to take a pretrained text-to-image model and combine it with a pretrained video frame interpolation model and the two actually fit together! I didn't have to re-train o…

>Talking alien!

Maybe that's what we were supposed to do all along. Not find or be found by aliens, but to invent them.

Re: Stable Diffusion animation

#100
post #96
post #16

Earlier quoted context omitted.

Back in the DOS days I had (and a still do) a copy of a tool called 'Morph', it took two GIF images, and you placed marker points on the first image and then again on the second, and it generated an MPEG2 file of the morphing. Very impressive for the time.

I had the "DMORPH" program, which had you construct a grid, and it would generate separate image for every frame. Then you had to use "DTA" to turn it into a FLIC file. No MPEG here, no animated .gif here, you had FLIC as your animation format.

FLIC animation, now that is a blast from the past!
Post reply on HN