It really makes me wonder if something like this is running inside my head. The prompt tho. Probably not text. Probably a stream of vibes or something.
You're lucky if so. I have something closer to pong running inside my head.
Sora: Creating video from text
671–680 of 1001 posts
Re: Sora: Creating video from text
#672Do we know anything yet about the maximum resolution of the output, or how long it takes to generate these kind of examples?
The technical report mentions it the training data was fed at up to 1920x1080 (allowing for a vertical 1080x1920 as well) so I'd guess that's why all of these videos were 1080p or lower, any larger and it probably gets wonky fast. I didn't see anything on absolute compute requirements and their impact on time to generate though.
Re: Sora: Creating video from text
#673If this can generate videos in real-time (60FPS), then you can, in theory, create any game just from text/prompts. You just write the rules of the game and the player input, and let the AI generate the next frame.
Pretty unlikely this generates in real-time.
Re: Sora: Creating video from text
#674I think the implications go much further than just the image/video considerations. This model shows a very good (albeit not perfect) understanding of the physics of objects and relationships between them. The announcement mentions this several times. The OpenAI blog post lists "Archeologists discover a generic plastic chair in the desert, excavating and dusting it with great care." as one of the "failed" cases. But t…
I'm hoping to see progress towards consistent characters, objects, scenes etc. So much of what I'd want to do creatively hinges on needing persisting characters who don't change appearance/clothing/accessories from usage to usage. Or creating a "set" for a scene to take place in repeatedly.
I know with stable diffusion there's things like lora and controlnet, but they are clunky. We still seem to have a long way to go towards scene and story composition.
Once we do, it will be a game changer for redefining how we think about things like movies and television when you can effectively have them created on demand.
Re: Sora: Creating video from text
#675I question how much anyone has really used these models if they actually think these systems can replace people. I’ve consistently failed to get professional results out of these things and the degree of work required to get professional results makes me think a new class of job will be created to get professional results out of these systems. That being said, there is value in these systems for casual use. For examp…
The more I use them, the more I get a sense of something fundamental that's missing, and the less I worry about losing my job. It's hard to describe, I need to think harder about what that feeling is.
Art is communication, it's as simple as that. Computer generated stuff isn't communicating anything.
Re: Sora: Creating video from text
#676This is leaps and bounds beyond anything out there, including both public models like SVD 1.1 and Pika Labs' / Runway's models. Incredible.
Yes, but I am stuck in their (American) view of what is consider appropriate. Not what is legal, but what they determine to be OK to produce. Good luck generating anything similar to an 80s action movie. The violence and light nudity will prevent you from generating anything.
I've been watching 80s movies recently, and amount of nudity and sex scenes often feels unnecessary. I'm definitely not a prude. I watch porn, I talk about sex with friends, I go to kinky parties sometimes. But it really feels that a lot of movies sacrificed stories to increase sex appeal — and now that people have free and unlimited access to porn, movies can finally be movies.
Re: Sora: Creating video from text
#677This looks like state of the art?
Re: Sora: Creating video from text
#678Does anyone else feel a sense of doom from these advancements? I'm definitely not a Luddite, I've been working professionally as a programmer for quite some time now, but I just can't shake this feeling. And this is not in the "I might lose my job to this" kind of feeling, that's obviously there, but it's something deeper, more sinister. I don't think I can explain it properly. Anyway, videos look incredible. I genui…
I think my thoughts went in a similarly sinister direction, when I saw it. I couldn't quiet grasp it. My mood wasn't euphoric, to say the least.
Tom Scott elaborated on this experience last year.[1] We should form a support group to commiserate.
Re: Sora: Creating video from text
#679OpenAI demonstrating the size of their moat. How many multi-million-dollar funded startups did this just absolutely obsolete? This is so, so, so much better than every other generative video AI we've seen. Most of those were basically a still image with a very slowly moving background. This is not that. Sam is probably going to get his $7T if he keeps this up, and when he does everybody else will be locked out foreve…
it wouldn't be too difficult to make a tiktok like app that created tailored prompts for sora based on the user and tracking data. Question is whether it is profitable
Hopefully, the line between the real world and virtual world gets stronger once again.
Re: Sora: Creating video from text
#680Watching these made me think, I'm going to want to go to the theatre a lot more in the future and see fellow humans in plays, lectures and concerts. Such achievements in technology must lead to cultural change. Look at how popular vinyl has become, why not theatre again.
Imagine movies generated in real-time just for you, with the faces you know, places you know and what not!
Your favorite shows, where the season never ends, and the actors never age.