[deleted]
Sora: Creating video from text
851–860 of 1001 posts
Re: Sora: Creating video from text
#852This is the harbinger that announces that, as a technologist, the time has come for me to witness more and more things that I cannot understand how they work any more. The cycle has closed and I have now become my father.
Thankfully it's nothing magical. But are you willing to learn about it or not?
Think about animation, how a program can generate a sequence of a bouncing ball between two key frames. Think about what defines a video. The frames right? From there I can try to imagine.
Re: Sora: Creating video from text
#853This is the harbinger that announces that, as a technologist, the time has come for me to witness more and more things that I cannot understand how they work any more. The cycle has closed and I have now become my father.
I'm on the very cusp of this, you helped me realize. Thanks.
Re: Sora: Creating video from text
#854The Hollywood Reporter says many in the industry are very scared.[1] “I’ve heard a lot of people say they’re leaving film,” he says. “I’ve been thinking of where I can pivot to if I can’t make a living out of this anymore.” - a concept artist responsible for the look of the Hunger Games and some other films. "A study surveying 300 leaders across Hollywood, issued in January, reported that three-fourths of respondents…
Honest question: of what possible use could Sora be for Hollywood? The results are amazing, but if the current crop of text-to-image tools is any guide, it will be easy to create things that look cool but essentially impossible to create something that meets detailed specific criteria. If you want your actor to look and behave consistently across multiple episodes of a series, if you want it to precisely follow a det…
The OpenAI announcement mentions being able to provide an image to start the video generation process from. That sounds to me like it will actually be incredibly easy to anchor the video generation to some consistent visual - unlike all the text-based stable diffusion so far. (Yes, there is img2img, but that is not crossing the boundary into a different medium like Sora).
Re: Sora: Creating video from text
#855This is insane. But I'm impressed most of all by the quality of motion . I've quite simply never seen convincing computer-generated motion before . Just look at the way the wooly mammoths connect with the ground, and their lumbering mass feels real. Motion-capture works fine because that's real motion, but every time people try to animate humans and animals, even in big-budget CGI movies, it's always ultimately obvio…
Don't think of them as "computer-generated" any more than your phone's heavily processed pictures are "computer-generated", or JWST's false color, IR-to-visible pictures are "computer-generated". This article makes a convincing argument: https://studio.ribbonfarm.com/p/a-camera-not-an-engine
That is such a gem of an article that looks at AI with a new lens I haven’t encountered before:
- AI sees and doesn’t generate
- It is dual to economics that pretends to describe but actually generates
Re: Sora: Creating video from text
#856This is insane. But I'm impressed most of all by the quality of motion . I've quite simply never seen convincing computer-generated motion before . Just look at the way the wooly mammoths connect with the ground, and their lumbering mass feels real. Motion-capture works fine because that's real motion, but every time people try to animate humans and animals, even in big-budget CGI movies, it's always ultimately obvio…
Maybe it's my anthropocentric brain, but the animals move realistically while the people still look quite off.
It's still an unbelievable achievement though. I love the paper seahorse whose tail is made (realistically) using the paper folds.
Re: Sora: Creating video from text
#857The Hollywood Reporter says many in the industry are very scared.[1] “I’ve heard a lot of people say they’re leaving film,” he says. “I’ve been thinking of where I can pivot to if I can’t make a living out of this anymore.” - a concept artist responsible for the look of the Hunger Games and some other films. "A study surveying 300 leaders across Hollywood, issued in January, reported that three-fourths of respondents…
Honest question: of what possible use could Sora be for Hollywood? The results are amazing, but if the current crop of text-to-image tools is any guide, it will be easy to create things that look cool but essentially impossible to create something that meets detailed specific criteria. If you want your actor to look and behave consistently across multiple episodes of a series, if you want it to precisely follow a det…
Right now you’d need a artistic/ML mixed team. You wouldn’t use an
off the shelf
tool. There was a video of some guys doing this (sorry can’t find it) to make an anime type animation. With consistent characters.
They used videos of themselves running through their own models to make the characters. So I reckon while prompt -> blockbuster is not here yet, a movie made using mostly AI is possible but it will cost alot now but that cost will go down. Why this is sad it is also exciting. And scary. Black mirror like we will start creating AI’s we will have relationships with and bring people back to life (!) from history and maybe grieving people will do this. Not sure if that is healthy but people will do it once it is a click of a button thing.
Re: Sora: Creating video from text
#858What is the first book you want to see movie of? It should be verbatim and last a week, if needed.
I vote for Hothouse, by Brian W Aldiss. So many images need to imagined, like spiders that jump to the moon and back again.
Re: Sora: Creating video from text
#859This is the harbinger that announces that, as a technologist, the time has come for me to witness more and more things that I cannot understand how they work any more. The cycle has closed and I have now become my father.
The difference is that now nobody really "understands" what's going on, it's just that some know how to build these.
Re: Sora: Creating video from text
#860This is insane. But I'm impressed most of all by the quality of motion . I've quite simply never seen convincing computer-generated motion before . Just look at the way the wooly mammoths connect with the ground, and their lumbering mass feels real. Motion-capture works fine because that's real motion, but every time people try to animate humans and animals, even in big-budget CGI movies, it's always ultimately obvio…
Just setup a family password last week...Now it seems every member of the family will have to become their own certificate authority and carry an MFA device.
"Worried About AI Voice Clone Scams? Create a Family Password" - https://www.eff.org/deeplinks/2024/01/worried-about-ai-voice...