Live data from Hacker News

Make-A-Video: AI system that generates videos from text

makeavideo.studio

141–150 of 399 posts

Re: Make-A-Video: AI system that generates videos from text

#141

Earlier quoted context omitted.

For those who are scared about this technology, it’s good to look at what AI has done to Chess. The best chess seems to be when AI is used along with humans. I think image and video AI will best be exploited when human input is also taken into account. There is still something special about human creativity, I think AI will just be another tool to expand that. At least, in the short term I would say 10 years perhaps.…

I may be mistaken but I believe that human/machine pairing was dominant for a long while, but the last few years the chess solvers have progressed to a point where they're dominant on their own. Poker on the other hand I think human players still win vs GTO solvers, but again I may be mistaken here too.

> Poker on the other hand I think human players still win vs GTO solvers, but again I may be mistaken here too.

Also an outsider, but I think this has changed in the last year and that AI now is consistently better than top-tier humans at even no-limits poker.

Re: Make-A-Video: AI system that generates videos from text

#142

As an owner of a Video Production studio, this kind of tech is blowing my mind and makes me equally excited and scared. I can see how we could incorporate such tools in our workflows, and at the same time I'm worried it'll be used to spam the internet with thousands and thousands of souless generated videos, making it even harder to look through the noise. A fun related experiment, I thought it was fun to see what ki…

For those who are scared about this technology, it’s good to look at what AI has done to Chess. The best chess seems to be when AI is used along with humans. I think image and video AI will best be exploited when human input is also taken into account. There is still something special about human creativity, I think AI will just be another tool to expand that. At least, in the short term I would say 10 years perhaps.…

Don't worry, humans will still be relevant for ~10 years!.

(and then regrettably irrelevant thereafter).

I think it is a legitimate worry, as the pace of progress is considerable. These tools are impressive, and are only going to get more impressive: more people should be talking about where this is headed.

Re: Make-A-Video: AI system that generates videos from text

#143

I'm rooting for this tech. Hopefully this will get modern movies out of their low risk reboot loop since it will be cheaper to make a movie that have new story lines that are commercially untested. I'd be happy to watch a movie that doesn't look AAA, but has compelling writing and makes me think. Or maybe I'll just stick to books.

I don't think modern movies are stuck in a "low risk reboot loop" because of the cost to produce, it's because of the potential profit. Why spend money on a film with new IP and ideas that you're not sure will be popular when the data science team has already worked with marketing to figure out exactly what movie will sell well? Good luck finding your movie with compelling and thought provoking writing in the big pil…

I was just thinking about this for the long tail problem in recommendation engines for stuff like video games. I blame the algorithms themselves.

We're in a situation where the very best algorithms (like the one used by Netflix), doing exactly what they're designed to do, create inequality and the vacuous economy of influencers we have today. Look at Steam or any other marketplace: they're all the same, with 1% of the players getting 99% of the prizes. In a very real way, the only winning move is not to play.

I would suggest that this tendency of capitalism (economic evolution) is unstoppable, and that it must be attacked from a different angle. If we don't want to inevitably end up in late-stage capitalism that looks like neofeudalism, then there has to be some form of redistribution or people spend the entirety of their lives running the rat race to make rent. Traditionally that was high taxes on the winners, but UBI would probably work better. Unfortunately, the very same people who win are the ones most resistant to any notion of a level playing field or social safety net.

So I feel like there may be no solution coming. We're probably looking at long slow decline for the next 15 years or so until AI reaches a level where economics don't really make sense anymore, since economic systems by definition control the distribution of resources under scarcity. Without scarcity, they're pointless. And we moved into the age of artificial scarcity sometime after WWII, probably in the late 1960s, but certainly no later than 1990 with the fall of the USSR and the rise of straw man enemies like terrorism, using divisive politics as the primary means of controlling the population. Noam Chomsky saw this coming before most of us were born.

In other words, when anyone can wish for anything by turning sentences into 3D-printed manifestations of their dreams, then artificial scarcity quickly loses its luster. Because the systems of control around dependency no longer work. Then a new fear-based enemy comes along to fill the void, probably aliens. I wish I was joking.

Re: Make-A-Video: AI system that generates videos from text

#145
post #3

This looks like the video equivalent of Dall-E 1. Hard to believe how far we've come so quickly. The paper talks about "pseudo 3D attention layers" that are used in place of temporal attention layers for each dimension due to memory consumption. It seems like AI research is vastly outpacing GPU development.

Indeed - it's not hard from a research point of view - it's hard from a compute perspective because adding one more dimension requires hundreds of times more compute. Even then, these videos are only like 50 frames long - and a real movie you would want to be hundreds of thousands of frames long.

>and a real movie you would want to be hundreds of thousands of frames long.

Yes, but consider that most films are made up of many different shots, each of which are often just seconds long.

Re: Make-A-Video: AI system that generates videos from text

#146

Wonder if all these things will bring about a kind of cambrian explosion of creativity. Imagine a future of Prompt Wizards, who are able to coax the AI to generate things in a very specific way. Although we would probably need a much greater level of human curation. The way algorithms curate on youtube and spotify just doesn't really hit the spot. Perhaps stability and Dall-e already kind of showed that the value is…

We already have evidence that the explosion in availability decreases the overall quality, even if the quantity of high-quality productions also increases greatly.

Every creative platform is going to be flooded with the equivalent of a Reddit comment.

(yes I am aware of the irony)

Re: Make-A-Video: AI system that generates videos from text

#147

Earlier quoted context omitted.

For those who are scared about this technology, it’s good to look at what AI has done to Chess. The best chess seems to be when AI is used along with humans. I think image and video AI will best be exploited when human input is also taken into account. There is still something special about human creativity, I think AI will just be another tool to expand that. At least, in the short term I would say 10 years perhaps.…

I may be mistaken but I believe that human/machine pairing was dominant for a long while, but the last few years the chess solvers have progressed to a point where they're dominant on their own. Poker on the other hand I think human players still win vs GTO solvers, but again I may be mistaken here too.

I think AI now beat humans at poker

https://www.sciencedaily.com/releases/2019/07/190711141343.h...

https://www.cs.cmu.edu/~noamb/papers/19-Science-Superhuman.p...

Re: Make-A-Video: AI system that generates videos from text

#148

A lot of people saying it's over for traditional movie-making - lmao. I look at these and see nothing but uncanny valley artifacts, and I don't think it will improve much from here. It's like self-driving cars. They use almost very effective statistical models, certainly better than our previous models, but they never seem to shake off that "almost" and become truly effective.

self-driving cars need safety guarantees. video's allowed to occasionally be crappy, it's not going to kill anyone.

I thought the same way you did about speech-to-text and image search, back in the day. boy was I wrong.

Re: Make-A-Video: AI system that generates videos from text

#149

Earlier quoted context omitted.

The Luddites were a labor rights movement reacting to the new shifting power dynamic of centralized production owned by a few, in an era with virtually no safety and worker rights regulations. How would you feel if your career evaporated and you were forced to choose between starvation and sending your children to work in a textile factory where they get maimed by the machines they're told to crawl into and repair? Y…

Whatever their motivation, their ire is misguided and selfish. Is the world supposed to just sit and around and never innovate or try to become more productive? So people can have a job doing work better done by machines? I don't think so. The Luddites and any such analogs today are focused on the wrong thing - they should not attack new technology or the companies and individuals using them, but rather campaign for…

Maybe new technology should be restricted by default until regulation can catch up with it. I'm not sure, but the 'cheap shirts benefit everybody too much to pump the brakes' argument for unfettered innovation leaves me deeply unimpressed.

IMHO the best argument for unfettered innovation is the impossibility of slowing innovation globally; it can be slowed in one country, but that country can't force all the rest to get with that program and will eventually be overtaken by technologically superior foes.

Re: Make-A-Video: AI system that generates videos from text

#150
post #116

Earlier quoted context omitted.

> the deep learning tech which will never quite get there Never say never, we've come a long way since GPT-2! All this was unthinkable back then

It's certainly possible. I find it somewhat unlikely though, despite the fast-paced progress.

I get the same feeling as well. This approach may well be eternal demo-ware, and you'll actually need AGI (or manual direction by a real human) to get to 100%.
Post reply on HN