Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Make-A-Video: AI system that generates videos from text

makeavideo.studio

Post reply on HN
Print view View original

151–160 of 399 posts

Re: Make-A-Video: AI system that generates videos from text

#151

Post by mjr00 »

echelon wrote: post #112
indigodaddy wrote: post #109

So how long before we can “Hey music-stable-diffusion-service,” play me “relaxing baroque violin and flute music in the style of game of thrones” ?

My start-up is working on this! We'll be launching a web and downloadable version soon. Eg. https://www.youtube.com/watch?v=r_0JjYUe5jo --> https://vocaroo.com/1hgjjnVNqWjk We're also working on film generation.

Not to insult your startup or your work (as this is pretty cool), but this is a good illustration of why that last 10% is so important. While the AI-generated song is 90% similar at a surface level, there's also no way anyone would listen to that track on Spotify if it came up on an Eminem playlist.

Re: Make-A-Video: AI system that generates videos from text

#152

Post by mortenjorck »

criddell wrote: post #16
VoodooJuJu wrote: post #12

A lot of people saying it's over for traditional movie-making - lmao. I look at these and see nothing but uncanny valley artifacts, and I don't think it will improve much from here. It's like self-driving cars. They use almost very effective statistical models, certainly better than our previous models, but they never seem to shake off that "almost" and become truly effective.

> I don't think it will improve much from here That's a bold prediction. Why do you think that? The first thing I thought was the exact opposite. This isn't very good, but it's only version 1. Motion pictures are less than 150 years old. In another 150 years I bet virtual filmmaking will progress a lot.

The key to predicting technological advancement, that is so often misunderstood by technologists, is the S-curve.

Laypeople tend to think everything is linear, technologists tend to think everything is exponential; more often than not, reality tends to be sigmoidal. Technologies have exponential takeoffs followed by logarithmic plateaus. We're clearly well into the exponential phase of deep-learning ML, but it's only a matter of time before this approach hits its logarithmic phase.

Of course, the hard part of sigmoidal prediction is determining where in the curve we are. Does the current paradigm have an even steeper part ahead of it? Maybe. And yet, we could just as easily be right in the middle of the function, with a leveling off coming as the state of the art gives way to incremental improvements.

Re: Make-A-Video: AI system that generates videos from text

#153

Post by algoatecorn »

5350-uiop-1130 wrote: post #68

Wonder if all these things will bring about a kind of cambrian explosion of creativity. Imagine a future of Prompt Wizards, who are able to coax the AI to generate things in a very specific way. Although we would probably need a much greater level of human curation. The way algorithms curate on youtube and spotify just doesn't really hit the spot. Perhaps stability and Dall-e already kind of showed that the value is…

https://twitter.com/chrisalbon/status/1567688342124503040

Re: Make-A-Video: AI system that generates videos from text

#154

Post by usefulcat »

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

> I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos

I agree, and I think when that happens, it will tend to increase the value of curation. High quality curation that is, probably done mostly by hand, as opposed to the at-best-mediocre automated curation that is commonly used.

It could be bad for things like YouTube, for example. I think there will be an arms race between generated video content one one side and automated curation on the other. I mean, you can still leverage viewer choices for curation (looking at what people are watching a lot of), but that is just shifting the burden of curation to users. Few people will be willing to sift through dozens of cheaply generated crap videos to find something they actually want to watch.

Re: Make-A-Video: AI system that generates videos from text

#156

Post by barbariangrunge »

slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

I know some extremely hard working independent filmmakers who struggle so hard to get noticed. After this tech goes mainstream in 5 years and gets really good, I don’t know what they’re going to do

Re: Make-A-Video: AI system that generates videos from text

#157

Post by BizarroLand »

SethMurphy wrote: post #131
generalizations wrote: post #105

Earlier quoted context omitted.

In the future version of this, the end user asks for a movie and gets a custom movie generated just for them. You want a thought-provoking Bourne-style action thriller with hints of Jane Austen and a bollywood dance sequence? How about a Matrix sequel that lives up to the first one, but ends just the way you like it? Just ask.

This could certainly be entertaining. The trick will be for the studios to continue to brand it as recognizable, yet have it be unique. It begs to ask what part of the experience will be a shared experience since it could be radically different for all of us. Would we then share the story created for us with friends? Will there be an Oscar for best mind to have a video created for them?

I think it would be great for people who write scripts for a movie they imagined.

You could conceivably write a script and feed it into a machine and have a decent 1080p rendition of the movie with consistent characters and voice acting which you could use to better pitch your movie idea to people, or get to watch a movie you created between you and your friends even if no one else ever gets to see it.

Re: Make-A-Video: AI system that generates videos from text

#158

Post by bottlepalm »

soheil wrote: post #123
bottlepalm wrote: post #102

Earlier quoted context omitted.

It’d be simpler to say there are no atoms, just a neural net fed into your senses making you think that there are atoms. The neural net itself is built on a much simpler substrate in an external universe.

And what exactly are your senses and your brain made out of?

In the sim theory, the external neural net tells us our brain is made of atoms.. you could theoretically feed your senses a Minecraft reality and you'd think your head is full of interacting blocks - which is still capable of performing the same NN functions as a wet brain... So I don't know, the brain could be made out of anything that fits the requirements of running the computation.

That's assuming there even really is one - senses can be hijacked, just like in dreams, so we may only think we have a brain - so strange.

Re: Make-A-Video: AI system that generates videos from text

#159

Post by cookingrobot »

TOMDM wrote: post #39
bottlepalm wrote: post #25

Earlier quoted context omitted.

The ‘outside’ reality only needs to be the size of a data center, not the entire universe. And maybe the outside reality only needs to be a trained 100gb model. A much simpler outside reality than we have now. You don’t even need to sim 8 billion people, just 1, you.

Occans razor in this case applies to the complexity giving rise to a situation here though, not the complexity of a described system. Conventional physics giving birth to our universe is currently the model with the fewest assumptions. What would have to take place to give rise to a universe the size of a data center, running an AI model of a human? It feels like we have to bake in assumptions of stable physics, a ri…

You only need a universe the size of a data center with nothing in it but a bit of vacuum fluctuation that causes particles to appear sometimes. Then just wait.

Re: Make-A-Video: AI system that generates videos from text

#160

Post by elephanlemon »

barbariangrunge wrote: post #156
slhomme wrote: post #121

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

I know some extremely hard working independent filmmakers who struggle so hard to get noticed. After this tech goes mainstream in 5 years and gets really good, I don’t know what they’re going to do

Make blockbusters, because scenes that would be incredibly expensive to shoot now will be practically free with this?
Post reply on HN