Live data from Hacker News

Video to video with Stable Diffusion

stable-diffusion-art.com

21–30 of 110 posts

Re: Video to video with Stable Diffusion

#21
post #12

Earlier quoted context omitted.

Mark my words. In a few years people will be writing filters and trying to figure out how to recreate the look of early AI animation.

...why? Do you expect GitHub and HuggingFace to go under in a few years?

We don't know actually. Could be Cease and Disease letters from creators of AI-networks, could be change in copyright laws, could be simply not profitable enough to continue operations or continue to store old data.

Re: Video to video with Stable Diffusion

#22
post #12
post #7

Not going to bother with this until the temporal cohesion issue is solved. The results are cool, but the variety in frames makes it look like a very specific and distracting art style instead of true animation.

Mark my words. In a few years people will be writing filters and trying to figure out how to recreate the look of early AI animation.

Nah, nobody is going to be figuring anything out, you'll be able to generate it with little effort with a prompt, just like everything else. But we will be so inundated by high quality digital art in every imaginable style that it will be boring, everything will be boring.

Re: Video to video with Stable Diffusion

#23
post #19

Earlier quoted context omitted.

...why? Do you expect GitHub and HuggingFace to go under in a few years?

The poster is just saying that "the "glitch" of today will be the nostalgic style of tomorrow".

Exactly. I have no idea what the other commenters thought I meant.

Re: Video to video with Stable Diffusion

#24
post #7

Not going to bother with this until the temporal cohesion issue is solved. The results are cool, but the variety in frames makes it look like a very specific and distracting art style instead of true animation.

Did you scroll down and see the different methods used, specifically method 5? Not perfect, but getting pretty close.

The last one looks the creepiest - like a dystopian matrix glitch. Could be a cool effect to illustrate that.

Re: Video to video with Stable Diffusion

#27
post #14
post #5

Earlier quoted context omitted.

There is another UI for workflow scripts: https://github.com/comfyanonymous/ComfyUI Give it enough times and it will also have the UI simplicity of automatic1111 UI.

automatic1111 isn't what immediately springs to mind when I hear the phrase "UI simplicity"

ComfyUI allow you to design your own workflow. It also mean understanding how things works, it's far harder to use than automatic1111 UI.

Re: Video to video with Stable Diffusion

#28
post #5
post #4

It's insane the speed of progress. That being said, the most smooth example in that tutorial (Temporal Kit) required a lot of outside processing. I wonder if AUTOMATIC1111 ui will start handling workflow scripts, a.l.a blender workflow boxes.

There is another UI for workflow scripts: https://github.com/comfyanonymous/ComfyUI Give it enough times and it will also have the UI simplicity of automatic1111 UI.

That's really impressive. This workflow in particular speaks of major potential:

https://comfyanonymous.github.io/ComfyUI_examples/controlnet...

Re: Video to video with Stable Diffusion

#30
post #7

Not going to bother with this until the temporal cohesion issue is solved. The results are cool, but the variety in frames makes it look like a very specific and distracting art style instead of true animation.

> the variety in frames makes it look like a very specific and distracting art style instead of true animation.

Well, what is "true animation"?

There are number of types of traditional animation where you draw both the characters and the backgrounds from scratch for every frame, so you get this variety naturally.

Or you have more practical techniques like strata-cut animation[1], where again you get what we might think of today as a very "ML-like" effect of the background constantly shifting.

All of these techniques are very time intensive, so you don't often see them in commercial animation.

[1]:https://en.wikipedia.org/wiki/Strata-cut_animation

Post reply on HN