Stable Video Diffusion

#1

Post by roborovskis » Tue, Nov 21, 2023, 7:01 PM UTC

Stable Video Diffusion
stability.ai

Re: Stable Video Diffusion

#2

Post by [deleted] » Tue, Nov 21, 2023, 7:05 PM UTC

[deleted]

Re: Stable Video Diffusion

#3

Post by minimaxir » Tue, Nov 21, 2023, 7:09 PM UTC

Model weights (two variations, each 10GB) are available without waitlist/approval: https://huggingface.co/stabilityai/stable-video-diffusion-im...

The LICENSE is a special non-commercial one: https://huggingface.co/stabilityai/stable-video-diffusion-im...

It's unclear how exactly to run it easily: diffusers has video generation support now but need to see if it plugs in seamlessly.

Re: Stable Video Diffusion

#4

Post by ronsor » Tue, Nov 21, 2023, 7:17 PM UTC

minimaxir wrote: post #3

Model weights (two variations, each 10GB) are available without waitlist/approval: https://huggingface.co/stabilityai/stable-video-diffusion-im... The LICENSE is a special non-commercial one: https://huggingface.co/stabilityai/stable-video-diffusion-im... It's unclear how exactly to run it easily: diffusers has video generation support now but need to see if it plugs in seamlessly.

Regular reminder that it is very likely that model weights can't be copyrighted (and thus can't be licensed).

Re: Stable Video Diffusion

#5

Post by [deleted] » Tue, Nov 21, 2023, 7:17 PM UTC

minimaxir wrote: post #3

Model weights (two variations, each 10GB) are available without waitlist/approval: https://huggingface.co/stabilityai/stable-video-diffusion-im... The LICENSE is a special non-commercial one: https://huggingface.co/stabilityai/stable-video-diffusion-im... It's unclear how exactly to run it easily: diffusers has video generation support now but need to see if it plugs in seamlessly.

[deleted]

Re: Stable Video Diffusion

#6

Post by chankstein38 » Tue, Nov 21, 2023, 7:19 PM UTC

minimaxir wrote: post #3

Model weights (two variations, each 10GB) are available without waitlist/approval: https://huggingface.co/stabilityai/stable-video-diffusion-im... The LICENSE is a special non-commercial one: https://huggingface.co/stabilityai/stable-video-diffusion-im... It's unclear how exactly to run it easily: diffusers has video generation support now but need to see if it plugs in seamlessly.

It looks like the huggingface page links their github that seems to have python scripts to run these: https://github.com/Stability-AI/generative-models

Re: Stable Video Diffusion

#7

Post by valine » Tue, Nov 21, 2023, 7:20 PM UTC

The rate of progress in ML this past year has been breath taking.

I can’t wait to see what people do with this once controlnet is properly adapted to video. Generating videos from scratch is cool, but the real utility of this will be the temporal consistency. Getting stable video out of stable diffusion typically involves lots of manual post processing to remove flicker.

Re: Stable Video Diffusion

#8

Post by ericpauley » Tue, Nov 21, 2023, 7:20 PM UTC

I'm still puzzled as to how these "non-commercial" model licenses are supposed to be enforceable. Software licenses govern the redistribution of the software, not products produced with it. An image isn't GPL'd because it was produced with GIMP.

Re: Stable Video Diffusion

#9

Post by helpmenotok » Tue, Nov 21, 2023, 7:20 PM UTC

Can this be used for porn?

Re: Stable Video Diffusion

#10

Post by christkv » Tue, Nov 21, 2023, 7:22 PM UTC

Looks like I'm still good for my bet with some friends that before 2028 a team of 5-10 people will create a blockbuster style movie that today costs 100+ million USD on a shoestring budget and we won't be able to tell.