11–20 of 38 posts
But the whole premise of AI video is that you're basically directing, and the model does all the hard parts for you.
Isn't modeling and animating the hardest part anyway? You're saving some time on texturing and lighting (which is still good, don't get me wrong). But the whole premise of AI video is that you're basically directing, and the model does all the hard parts for you.
I'm aware this is only a very tangential comparison, but my LLM-based coding workflows around Cursor regularly involve me creating "empty" skeletons of files which I add to the context, as in: because I'm aware that it makes sense for an implementation to have a FooBarService and two entities Fizz and Buzz, I create these as empty files (with the "class FoobarService" line as it's only content), and this way, Cursor…
I can see how it helps to feed a 60% final product, but at that point isn't it style transfer, or, DLSS?
Got an error (literally just said "Error") trying to sign up for the waitlist, FF mobile on Android.
Not an expert here. I am not sure how 3D the videos in the article are. IMO they are 3D in a pixar/animated sort of way. But I have very recent first hand experience of creating a video for our startup's Facebook post with Minimax image-to-video inference, from an image of our animated avatar character. ...And yes, first the videos were bad quality with lots of inconsistencies, but after adding "animated" to the prom…
Your experience with Minimax sounds cool! Adding 'animated' to the prompt helping consistency makes sense—AI models often struggle with structure, so any guidance helps.
AI-generated video struggles with consistency. Flickering, weird proportions, and characters changing. I tried using 3D as a way to get more consistency. Overall, it worked. No sudden changes in proportions, clothing, or style. Still, there are some limitations, especially with fine details. We’re looking into whether this could be useful as a tool and would love to hear what you think: Has anyone experimented with 3…
1. The users with experience and patience for this are slim. Blocking out a scene and the animation are tough, and the users with this skill and inclination are using Blender and ComfyUI already or are submitting renders to RunwayML V2V. We're still too early for AI auto rigging and animation to work, though those technologies will make this approach easier.
2. AI video users want I2V quality and predictability, not unpredictable V2V style transfer. You need control over the exact look and feel of the starting frame as well as the animation. If you can't get this, the renders are useless.
3. One of the advantages of AI video is that it can animate things a human animator cannot easily do. Non-humanoids, crowd movements, explosions, etc.
Basically, this requires deep integration with a new class of video model.
You'll find that even with this technology perfected, it fits into a comprehensive suite of tools that AI video creators will use. They will still lean on I2V for most shots and V2V compositing for other shots.
I've done a lot of hands-on interviews and demos. Steve May, various studios, schools, etc. Steve kind of negged me and told me there are bigger players working on this. My guess was Odyssey Systems at the time, but they turned out to be working on something else.
I do think this is a valuable technology, but there's a tremendous amount of work to do to make it work.
Isn't modeling and animating the hardest part anyway? You're saving some time on texturing and lighting (which is still good, don't get me wrong). But the whole premise of AI video is that you're basically directing, and the model does all the hard parts for you.
Yeah, modeling and animating used to be a huge bottleneck, but with tools like image-to-3D and improving AI animation models, it's getting easier and faster. The goal here isn’t to replace animation but to use 3D as a guide, so AI doesn’t have to guess everything from scratch. In this workflow, you don’t even need animations—just static 3D models. The output is a single image that gets passed to a video model, which…
That makes it a lot more useful.