Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sora: Creating video from text

openai.com

Post reply on HN
Print view View original

681–690 of 1001 posts

Re: Sora: Creating video from text

#681

Post by Animats »

snewman wrote: post #637
Animats wrote: post #588

The Hollywood Reporter says many in the industry are very scared.[1] “I’ve heard a lot of people say they’re leaving film,” he says. “I’ve been thinking of where I can pivot to if I can’t make a living out of this anymore.” - a concept artist responsible for the look of the Hunger Games and some other films. "A study surveying 300 leaders across Hollywood, issued in January, reported that three-fourths of respondents…

Honest question: of what possible use could Sora be for Hollywood? The results are amazing, but if the current crop of text-to-image tools is any guide, it will be easy to create things that look cool but essentially impossible to create something that meets detailed specific criteria. If you want your actor to look and behave consistently across multiple episodes of a series, if you want it to precisely follow a det…

I suspect that one of the first applications will be pre-viz. Before a big-budget movie is made, a cheap version is often made first. This is called "pre-visualization". These text to video applications will be ideal for that. Someone will take each scene in the script, write a big prompt describing the scene, and follow it with the dialog, maybe with some commands for camerawork and cuts. Instant movie. Not a very good one, but something you can show to the people who green-light things.

There are lots of pre-viz reels on line. The ones for sequels are often quite good, because the CGI character models from the previous movies are available for re-use. Unreal Engine is often used.

Re: Sora: Creating video from text

#682

Post by nopinsight »

grbsh wrote: post #668
nopinsight wrote: post #257

Many might miss the key paragraph at the end: "Sora serves as a foundation for models that can understand and simulate the real world, a capability we believe will be an important milestone for achieving AGI." This also helps explain why the model is so good since it is trained to simulate the real world, as opposed to imitate the pixels. More importantly, its capabilities suggest AGI and general robotics could be cl…

I think you are reading too far into this. The title of the technical paper is “ Video generation models as world simulators”. This is “just” a transformer that takes in a sequence of noisy image (video frame) tokens + prompt, and produces a sequence of less noisy video tokens. Repeat until noise gone. The point they’re making, which is totally valid, is that in order for such a model to produce videos with realistic…

AlphaGo and AlphaZero were able to achieve superhuman performance due to the availability of perfect simulators for the game of Go. There is no such simulator for the real world we live in. (Although pure LLMs sorta learn a rough, abstract representation of the world as perceived by humans.) Sora is an attempt to build such a simulator using deep learning.

This actually affirms my comment above.

  “Our results suggest that scaling video generation models is a promising path towards building general purpose simulators of the physical world.”
https://openai.com/research/video-generation-models-as-world...

What part of my argument do you disagree about?

Re: Sora: Creating video from text

#683

Post by al_borland »

pants2 wrote: post #635

Another step in the trend of everything becoming digital (in film and otherwise). It used to be that everything was done in camera. Then we got green screens, then advanced compositing, then CGI, then full realistic CGI movies modeled after real things and mocap suits. Now we're at the end game, where there will be no cameras used in the production of a movie, just studios of people sitting at their computers. Becaus…

A bicycle for the mind.

Re: Sora: Creating video from text

#684

Post by ge96 »

cyrialize wrote: post #409

Does anyone know how to handle the depression/doom one feels with these updates? Yes, it's a great technical achievement, but I just worry for the future. We don't have good social safety nets, and we aren't close to UBI. It's difficult for me to see that happen unless something drastic changes. I'm also afraid of one company just having so much power. How does anyone compete?

When I find out something was made with AI/I unknowingly interacted with it, I feel like I got owned.

Also I think there will be more junk out there with how easy it will be to mass produce garbage.

Re: Sora: Creating video from text

#685

Post by kypro »

hello_newman wrote: post #662
itissid wrote: post #487

How does one cope with this? - Disruptions like this happen to every industry every now and then. Just not on the level of "Communicating with people with words, and pictures". Anduril and SpaceX disrupted defense contractors and United Launch Alliance; Someone working for a defense contractor/ULA here affected by that might attest to the feeling? - There will be plenty of opportunity to innovate. Industries are bein…

Totally agree with you. Most of the responses in this thread remind me of why I don't typically go into the comment section of these announcements. It's way too easy to fall into the trap set by the doomsday-predicting armchair experts, who make it sound like we're on the brink of some apocalypse. But anyone attempting to predict the future right now is wasting time at best, or intentionally fear mongering at worst.…

> But wasting time worrying about all the "what ifs" doesn't help anyone.

Worry about the what if is all we have as a species. If we don't worry about how stop global warming, or how we can prevent a nuclear holocaust these things become more far more likely.

If OpenAI drops an AGI bomb on us then there a good chance that's it for us. From there it will just be a matter of time before a rouge AGI or a human working with an AGI causes mass destruction. This is every bit as dangerous as nuclear weapons - if not more dangerous – yet people seem unable to take the matter as seriously as it needs to be taken.

I fear millions of people will need to die or tens of millions will need to be made unemployable before we even begin to start asking the right questions.

Re: Sora: Creating video from text

#686

Post by al_borland »

comicjk wrote: post #517
rglover wrote: post #454

I was super on board until I saw... the paw : https://player.vimeo.com/video/913131059?h=afe5567f31&badge=... Exciting for the potential this creates, but scary for the social implications (e.g., this will make trial law nearly impossible).

If I understand trial law correctly, the rules of evidence already prohibit introducing a video at trial without proving where it came from (for example, testimony from a security guard that a given video came from a given security camera). But social media has no rules of evidence. Already I see AI-generated images as illustrations on many conspiracy theory posts. People's resistance to believing images and videos f…

All the more reason why we need to rely on the courts and not the mob justice (in the social sense) which has become popular over the last several years.

Re: Sora: Creating video from text

#687

Post by al_borland »

kweingar wrote: post #206

Obviously incredibly cool, but it seems that people are incredibly overstating the applications of this. Realistically, how do you fit this into a movie, a TV show, or a game? You write a text prompt, get a scene, and then everything is gone—the characters, props, rooms, buildings, environments, etc. won’t carry over to the next prompt.

Family Guy is built on out of context clips.

It could also fill it for background videos in scenes, instead of getting real content they’d have to pay for, or making their own. The gangster movie Kevin was playing in Home Alone was specifically shot for that movie, from what I remember.

Re: Sora: Creating video from text

#688

Post by geor9e »

darkhorse13 wrote: post #460

Does anyone else feel a sense of doom from these advancements? I'm definitely not a Luddite, I've been working professionally as a programmer for quite some time now, but I just can't shake this feeling. And this is not in the "I might lose my job to this" kind of feeling, that's obviously there, but it's something deeper, more sinister. I don't think I can explain it properly. Anyway, videos look incredible. I genui…

I feel the opposite. I've been overwhelmed with a sense of my mortality, that I need to care for my body better, in order to live as long as possible into this age. I feel like I won the lottery of birth date to be able to see this. I get your perspective, and I have no doubt the wealth gap will widen painfully, but I'm also optimistic about humanity's ability to work it out.

Re: Sora: Creating video from text

#689

Post by StarterPro »

Call me whatever you want, but this technology should not exist.

People to just create lifelike videos of anything they can put their mind to, is bound to lead to the ruining of many peoples' lives.

As many people that are aware and interested in this technology, there is 100x people who have no idea, don't care or can't comprehend it. Those are the people that I fear for. Grab a few pictures of the grandkids off of facebook, and now they have a realistic ransom video to send.

Am i being hyperbolic? I don't think so. Anything made by humans can be broken. And once its broken and out there, good luck.

Re: Sora: Creating video from text

#690

Post by a_wild_dandan »

comicjk wrote: post #517
rglover wrote: post #454

I was super on board until I saw... the paw : https://player.vimeo.com/video/913131059?h=afe5567f31&badge=... Exciting for the potential this creates, but scary for the social implications (e.g., this will make trial law nearly impossible).

If I understand trial law correctly, the rules of evidence already prohibit introducing a video at trial without proving where it came from (for example, testimony from a security guard that a given video came from a given security camera). But social media has no rules of evidence. Already I see AI-generated images as illustrations on many conspiracy theory posts. People's resistance to believing images and videos f…

Nothing will change. Confirmation bias junkies already accept far worse fakes. People who use trusted sources will continue doing so. Bumping the quantity/quality of fabricated horseshit won't move the needle.
Post reply on HN