41–50 of 107 posts
Last year, when 3090 GPUs were astronomically priced, I thought "screw it, I'll just buy an RTX A5000 for a couple of hundred bucks more." Which begat a second A5000 for "reasons." It was almost prescient. Now all these models are coming out requiring slightly higher VRAM GPUs than a 3090, i.e. more in the range of the A5000, and I get to run them. I am a kid in a candy store this past couple of weeks.
The A5000 and 3090 both have 24GB of ram?
Andreas, author of the Replicate model here -- though "author" feels wrong since I basically just stitched two amazing models together. The thing that really strikes me is that open source ML is starting to behave like open source software. I was able to take a pretrained text-to-image model and combine it with a pretrained video frame interpolation model and the two actually fit together! I didn't have to re-train o…
This is simply very impressive... whether or not it was humbly stitched together, you were sort of the first to do it, so take pride.
The next real magic will be reading its net and figuring out how to get [vfx/film] effects from it... which if I were you would probably occupy 22 hours of my day now.
AI in animation has been interesting to me for a while now. It leaves me a little conflicted though. If we get to the point where we can throw key drawings at AI and let it handle all the inbewteens without a bunch of tweaking and cleanup afterwards it's going to really suck for places like Korea! I guess all those inbeatweeners will just be another victim of automation. I've always loved animation, but I'll admit pa…
> leaves me a little conflicted though. If we get to the point where we can throw key drawings at AI and let it handle all the inbewteens without a bunch of tweaking and cleanup afterwards it's going to really suck for places like Korea! These comments on every single post are getting really boring.
While I can't expect it to interest everyone, I don't personally mind discussions of specific industries when it looks like their time is coming up though. Each industry is going to have to deal with the change in their own way and we'll all have to adapt in different ways. The more interested in the industry I am, the more interesting I'll find it's decline/collapse. Brace yourself, because when AI comes for the coders that topic is going to dominate this site for some time (at least until the AIs themselves start commenting)
Earlier quoted context omitted.
This is not an example of AI handling the inbetweens. This water-morph effect is undesirable for inbetweens.
You're right, but projects like this do make me think AI handling inbetweens well enough to replace animators is where we'll end up eventually and that it's probably not far off.
The artwork is inside a scene, SD does not understand that scene. The artwork has spatial and human readable emotional relationships. SD does not understand those relationships.
SD can maybe create morphs between frames, as a lateral move between two pieces of generated information, but it will never know how to connect up those images in a manner that satisfies the human requirement of creating a good image.
We already have mathematical tools for interpolating between frames. They are wholly unsatisfying for creating novel artworks. Adding SD to that stack doesn't magically solve that problem.
Your dream idea of killing the inbetween with mathematics would require automating what an artist does by hand to construct and bend space-time upon a blank piece of paper. Describing what an artist does takes time. CTRL+Paint does a good job. With mapping out every possible emotional/visual interpretation of those shapes, between the two frames and allowing the user to pick the resulting outcome.
That is the "tea, earl grey, hot" star trek replicator for art inbetweens. SD is just another tool for filling in gaps with random spam. The real value in this, is that there's a hoarde of young people who want SD and it's outcome. The real art will continue unphased, using SD as a tool, where it fits.
Last year, when 3090 GPUs were astronomically priced, I thought "screw it, I'll just buy an RTX A5000 for a couple of hundred bucks more." Which begat a second A5000 for "reasons." It was almost prescient. Now all these models are coming out requiring slightly higher VRAM GPUs than a 3090, i.e. more in the range of the A5000, and I get to run them. I am a kid in a candy store this past couple of weeks.
Last year, when 3090 GPUs were astronomically priced, I thought "screw it, I'll just buy an RTX A5000 for a couple of hundred bucks more." Which begat a second A5000 for "reasons." It was almost prescient. Now all these models are coming out requiring slightly higher VRAM GPUs than a 3090, i.e. more in the range of the A5000, and I get to run them. I am a kid in a candy store this past couple of weeks.
The A5000 and 3090 both have 24GB of ram?
In this example, 25 frames are generated using Stable Diffusion, then frames are interpolated using FILM-Net. I hadn't see FILM-net before, it looks really neat.
This? Looks pretty amazing: https://film-net.github.io https://github.com/google-research/frame-interpolation
I feel like I’m watching an explosion of progress in AI image generation in real-time. Every day there’s a new application of Stable Diffusion. It’s incredible to watch unfold
I think it's pretty notable how most of the explosion happened since stable diffusion released their model and code as open source, while Dall-E generated initial excitement with their closed source model, but limited progress / creativity since. It's a pretty nice demonstration I think of how much innovation can happen from openness.
Very cool! I generated this with 1000 images https://twitter.com/UnshushProject/status/156315821457709465... using the Deforum's Colab[1], it's really easy and now has interpolation too. It was the very first video, I could have made something great but, you know, awesome guys keep releasing AI tech and I'm like a child at Luna Park right now, not able to concentrate. If you are interested in my project (I doubt, you…
You have generated some pretty cool designs.