Sora is here
451–460 of 1001 posts
Re: Sora is here
#452Re: Sora is here
#453> We’re introducing our video generation technology now to give society time to explore its possibilities and co-develop norms and safeguards that ensure it’s used responsibly as the field advances. That's an interesting way of saying "we're probably gonna miss some stuff in our safety tools, so hopefully society picks up the slack for us". :)
Do we not want new stuff? If the answer is "Sure, but only if whoever invents the stuff does all the work and finds all rough edges" then the answer is actually just "No, thanks".
Re: Sora is here
#454Earlier quoted context omitted.
There is no problem unless you insist on reflecting what you had in mind exactly . That needs minute controls, but no matter the medium and tools you use, unless you're doing it in your own quest for artistic perfection, the economic constraints will make you stop short of your idea - there's always a point past which any further refinement will not make a difference to the audience (which doesn't have access to the…
I disagree. Even without exactness, adding any reasonable constraints is impossible. Ask it to generate a realistic circuit diagram or chess board or any other thing where precision matters. Good luck going back and forth getting it right. These are situations with relatively simple logical constraints, but an infinite number of valid solutions. Keep in mind that we are not requiring any particular configuration of c…
That doesn't mean it can't work with AI - it's that you may need to add something extra to the generative pipeline, something that can do circuit diagrams, and make the diffusion model supply style and extra noise (er, beautifying elements).
> Keep in mind that we are not requiring any particular configuration of circuit diagram, just any diagram that makes sense. There are an infinite number of valid ones.
On that note. I'm the kind of person that loves to freeze-frame movies to look at markings, labels, and computer screens, and one thing I learned is that humans fail at this task too. Most of the time the problems are big and obvious, ruining my suspension of disbelief, and importantly, they could be trivially solved if the producers grabbed a random STEM-interested intern and asked for advice. Alas, it seems they don't care.
This is just a specific instance of the general problem of "whatever you work with or are interested in, you'll see movies keep getting it wrong". Most of the time, it's somewhat defensible - e.g. most movies get guns wrong, but in way people are used to, and makes the scenes more streamlined and entertaining. But with labels, markings and computer screens, doing it right isn't any more expensive, nor would it make the movie any less entertaining. It seems that the people responsible don't know better or care.
Let's keep that in mind when comparing AI output to the "real deal", as to not set an impossible standards that human productions don't match, and never did.
Re: Sora is here
#455I've found using these and similar tools that the amount of prompts and iteration required to create my vision (image or video in my mind) is very large and often is not able to create what I had originally wanted. A way to test this is to take a piece of footage or an image which is the ground truth, and test how much prompting and editing it takes to get the same or similar ground truth starting from scratch. It is…
Sora is obviously not Photoshop, but given that you can write basically anything you can think of I reckon it's going to take a long time to get good at expressing your vision in words that a model like Sora will understand.
Re: Sora is here
#456I know there is Beautiful.ai or Copilot for PowerPoint, but none of the existing tools really work for me because the results and the user flow aren’t convincing.
Re: Sora is here
#457Earlier quoted context omitted.
Sora was not really that big of a revolution, it was just catching up with competitors. I would even say in gen video they are behind right now.
Sora had some sweet cherry picked initial hype videos. That was more impressive than anything we could do at the time. Now, yea, it's questionable if it's on-par let alone better.
Re: Sora is here
#458Re: Sora is here
#459Earlier quoted context omitted.
I've ran hunyuanvideoai from their GitHub and it seems to generate realistic videos. It is a bit slow (30-60min per video clip) and requires ~50GB VRAM. I wonder how the quality compares though?
oh, and the output videos that are generated are 5sec clips at 554x960px. this is on a single A6000
Re: Sora is here
#4601. Anything that is in the world when you’re born is normal and ordinary and is just a natural part of the way the world works.
2. Anything that's invented between when you’re fifteen and thirty-five is new and exciting and revolutionary and you can probably get a career in it.
3. Anything invented after you're thirty-five is against the natural order of things.”
― Douglas Adams, The Salmon of Doubt: Hitchhiking the Galaxy One Last Time