Anyone else find this stuff extremely distasteful? "Disrupting" creativity and art feels like it goes against our humanity.
The past few years' innovation in AI has roughly been split into two camps for me. LLMs -- Awesome and useful. Disruptive, and somewhat dangerous, but probably more good than harm if we do it right. 'Generative art' (i.e. music generation, image generation, video generation) -- Why? Just why? The 'art' is always good enough to trick most humans at a glance but clearly fake, plastic, and soulless when you look a bit c…
Sora is here
371–380 of 1001 posts
Re: Sora is here
#372I got lucky and got in moments after it launched, managed to get a video of "A pelican riding a bicycle along a coastal path overlooking a harbor" and then the queue times jumped up (my second video has been in the queue for 20+ minutes already) and the https://sora.com site now says "account creation currently unavailable" Here's my pelican video: https://simonwillison.net/2024/Dec/9/sora/
I don't have a lot of mental model for how this works, but I was surprised to note that it seems to maintain continuity on the shapes of the bushes and brown spots on the grass that track out of frame on the left and then reappear as it pans back into frame.
Re: Sora is here
#373Earlier quoted context omitted.
> For instance, that ladybug looks pretty natural, but there's a little glitch in there that an unwitting observer, who's never seen a ladybug move before, may mistake as being normal. And maybe it is! And maybe it isn't? Well, none of the existing animation movies follow exact laws of physics.
Animation doesn't follow exact laws of physics, but the specific ways they don't follow physics have very deliberate intent behind them. There's a pretty clear difference between the coyote running off a cliff and taking 2 seconds to start falling, and a character awkwardly floating over the ground because an AI model got confused.
That is only true for well crafted things. There's plenty of stuff that's just wrong for no reason beyond ease of creation or lack of care about the output.
Re: Sora is here
#374I've found using these and similar tools that the amount of prompts and iteration required to create my vision (image or video in my mind) is very large and often is not able to create what I had originally wanted. A way to test this is to take a piece of footage or an image which is the ground truth, and test how much prompting and editing it takes to get the same or similar ground truth starting from scratch. It is…
And another thing that irks me: none of these video generators get motion right... Especially anything involving fluid/smoke dynamics, or fast dynamic momements of humans and animals all suffer from the same weird motion artifacts. I can't describe it other than that the fluidity of the movements are completely off. And as all genai video tools I've used are suffering from the same problem, I wonder if this is someho…
Re: Sora is here
#375Earlier quoted context omitted.
Yes but a movie is a movie whereas these AI-generated videos will likely be used to replace stock footage in other (documentary, promotional, etc.) contexts
If the producer wants to publish bad physics, they get bad physics. If the producer wants to publish good physics, they get good physics. It doesn't matter if it is AI, CGI, live action, stop motion, pen-and-ink animation, or anything else. The output is whatever the production team wants it to be, just as has been the case for as long as we've had cinema (or advertising or documentaries or TikToks or whatevers). Not…
There's a video on sora.com at the very bottom, with tennis players on the roof, notice how one player just walks "through" the net. I don't think you can fix this other than by just cutting the video earlier.
Re: Sora is here
#376A little worried how young children watching these videos may develop inaccurate impressions of physics in nature. For instance, that ladybug looks pretty natural, but there's a little glitch in there that an unwitting observer, who's never seen a ladybug move before, may mistake as being normal. And maybe it is! And maybe it isn't? The sailing ship - are those water movements correct? The sinking of the elephant int…
If you really want something to worry about, consider that movies regularly show pint-sized women successfully drop kicking men significantly bigger than themselves in ways that look highly plausible but aren't. It's not AI but it violates basic laws of biology and physics anyway. Teaching girls they can physically fight off several men at once when they aren't strong enough to do that seems like it could have pretty dangerous consequences, but in practice it doesn't seem to cause problems. People realize pretty quick that movie physics isn't real.
Re: Sora is here
#377Earlier quoted context omitted.
> Now expand that to movies and games and you can get why this whole generative-AI bubble is going to pop. What will save it is that, no matter how picky you are as a creator, your audience will never know what exactly was that you dreamed up, so any half-decent approximation will work. In other words, a corollary to your corollary is, "Fortunately, you don't need them to be, because no one cares about low-order bits…
That's just sad, and why people have a derogative stance towards generative AI: "half-decent" approximation removes all personality from the output, leading to a bunch of slop on the internet.
It's less obvious because people project personality onto the content they see, because they implicitly assume the artist cared, and had some vision in mind. Cheap shit doesn't look like cheap shit in isolation. Except when you know it's AI-generated, because this removes the artist from the equation, and with it, your assumptions that there's any personality involved.
Re: Sora is here
#378Earlier quoted context omitted.
> the idea is very obvious but they haven't done it because they don't have the wherewithal to do so Fascinating! I wish I had the knowledge and wherewithal to do that and become rich instead of wasting my time on HN.
No one is perfect but you should try to do better and waste less time on HN now that you're aware and can act on that knowledge.
Re: Sora is here
#379I've found using these and similar tools that the amount of prompts and iteration required to create my vision (image or video in my mind) is very large and often is not able to create what I had originally wanted. A way to test this is to take a piece of footage or an image which is the ground truth, and test how much prompting and editing it takes to get the same or similar ground truth starting from scratch. It is…
The adage "a picture is worth a thousand words" has the nice corollary "A thousand words isn't enough to be precise about an image". Now expand that to movies and games and you can get why this whole generative-AI bubble is going to pop.
Trust me, even if you work with human artists, you'll keep saying "it's not quite I initially invisioned, but we don't have budget/time for another revision, so it's good enough for now." all the time.
Re: Sora is here
#380A little worried how young children watching these videos may develop inaccurate impressions of physics in nature. For instance, that ladybug looks pretty natural, but there's a little glitch in there that an unwitting observer, who's never seen a ladybug move before, may mistake as being normal. And maybe it is! And maybe it isn't? The sailing ship - are those water movements correct? The sinking of the elephant int…