Make-A-Video: AI system that generates videos from text • Hacker News Board

Re: Make-A-Video: AI system that generates videos from text

#231

Post by synu » Thu, Sep 29, 2022, 5:26 PM UTC

sixQuarks wrote: post #128

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

For those who are scared about this technology, it’s good to look at what AI has done to Chess. The best chess seems to be when AI is used along with humans. I think image and video AI will best be exploited when human input is also taken into account. There is still something special about human creativity, I think AI will just be another tool to expand that. At least, in the short term I would say 10 years perhaps.…

There are two classes of engines. One is like you describe, faster and faster brute forcing. AlphaZero was much more creative and didn’t use brute force.

Re: Make-A-Video: AI system that generates videos from text

#232

Post by babyshake » Thu, Sep 29, 2022, 5:27 PM UTC

maxov wrote: post #179

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

I love this! But after trying it a few times I got this result :). So fascinating. https://thismoviedoesnotexist.org/movie/the-terminator Brings up the age-old question of how much the learning in these models is just memorization. Though in cases like these it’s hard to tell.

Not sure how I feel about an AI generating a movie concept that involves a "rise of the machines".

Re: Make-A-Video: AI system that generates videos from text

#233

Post by agitator » Thu, Sep 29, 2022, 5:28 PM UTC

What's mind blowing is that you can extrapolate where this is going to go. Eventually, you will be able to generate full movie scenes from descriptions.

What's interesting to me is how this is so similar to human imagination. Give me a description and I will fabricate the visuals in my mind. Some aspects will be detailed, others will be vague, or unimportant. Crazy to see how fast AI is progressing. Machines are approaching the ability to interpret and visualize text in the same way humans can.

This also fascinates me as a form of compression. You can transmit concepts and descriptions without transmitting pixel data, and the visuals can be generated onsite. Wonder if there is some practical application for this.

Re: Make-A-Video: AI system that generates videos from text

#234

Post by sergiotapia » Thu, Sep 29, 2022, 5:30 PM UTC

At the rate AI is advancing, are we heading to a post-scarcity society, or a class of technolords and the other 99% scavenging for scraps.

Re: Make-A-Video: AI system that generates videos from text

#235

Post by nonima » Thu, Sep 29, 2022, 5:32 PM UTC

sixQuarks wrote: post #128

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

For those who are scared about this technology, it’s good to look at what AI has done to Chess. The best chess seems to be when AI is used along with humans. I think image and video AI will best be exploited when human input is also taken into account. There is still something special about human creativity, I think AI will just be another tool to expand that. At least, in the short term I would say 10 years perhaps.…

>it’s good to look at what AI has done to Chess It completely ruined the game to the point where it's more about memorization than it's ever been.

Re: Make-A-Video: AI system that generates videos from text

#236

Post by hugozap » Thu, Sep 29, 2022, 5:32 PM UTC

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

Is the generation happening in real time? I'm curious about the costs of running something like this.

Re: Make-A-Video: AI system that generates videos from text

#237

Post by tracyhenry » Thu, Sep 29, 2022, 5:32 PM UTC

Is the limitation that all pixels in the video would come from the first frame? since they are predicting pixel motion, basically.

Re: Make-A-Video: AI system that generates videos from text

#238

Post by mattnewton » Thu, Sep 29, 2022, 5:33 PM UTC

mjr00 wrote: post #140

indigodaddy wrote: post #109

So how long before we can “Hey music-stable-diffusion-service,” play me “relaxing baroque violin and flute music in the style of game of thrones” ?

A long time. Much like self-driving cars, AI can take you 90% of the way there, but the last 10% is the difference between music that sort-of-seems-competent, and music that people will actually listen to and enjoy.

I think it will take a lot less time than self driving cars because testing and iteration is so much cheaper. I would say that, in 5 years this feature will be part of a major commercial streaming service and people listen to it and enjoy it enough to keep using the feature.

Re: Make-A-Video: AI system that generates videos from text

#239

Post by Dracophoenix » Thu, Sep 29, 2022, 5:35 PM UTC

skocznymroczny wrote: post #129

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

Reminds me of South Park when Cartman was pretending to be a robot and was made to invent movie prompts "Adam Sandler is like, in love with some girl, but then it turns out that the girl is actually a Golden Retriever. Or something.""

Or the "Two Brothers" skit from Rick and Morty.

https://www.youtube.com/watch?v=ba9k5SWwE38

Re: Make-A-Video: AI system that generates videos from text

#240

Post by permo-w » Thu, Sep 29, 2022, 5:35 PM UTC

I really don’t understand the fear people have about these things. have I missed something and everyone else was placing huge value in out of context videos and pictures?

if you read “France declares war on Canada”, you’re not gonna believe it unless it’s coming from an extremely reputable source. so why would you trust a random unsourced video?

the absolute worst thing that’s gonna happen is that video-based social media is gonna be flooded with low (or even high) quality AI videos. and I ask you: who the fuck cares? are these places doing wonders for society as it is? what’s a bit more rubbish amongst all the rest?

I can think of many, many more upsides than down