Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a web app to bring children's drawings to life

doodledreams.cc

Post reply on HN
Print view View original

71–80 of 82 posts

Re: Show HN: I made a web app to bring children's drawings to life

#71

Post by nox101 »

vunderba wrote: post #25

Meta put out a pretty popular post back in 2021 around using AI to animate children's drawings. I believe it focuses more around using masks to build out a "rigging" to animate them. https://about.fb.com/news/2021/12/using-ai-to-animate-childr... https://fairanimateddrawings.com Conversely, sounds like this is just feeding directly into the Kling API though. I'd say pricing is going to be the roughest aspect since th…

Following those links lead to this website based free solution

https://sketch.metademolab.com/

You can upload a picture and have it animate it. Not quite the same or as impressive but still might be fun and it's free

Re: Show HN: I made a web app to bring children's drawings to life

#73

Post by bambax »

vikmex wrote: post #61
bambax wrote: post #57

That's cool. Can you talk a little about the tech: front end, back end, and API (Kling, apparently)?

Hi, Frontend is built using React and for the backend I created a python flask server that runs on Google Cloud, and I use Firebase for database, authentication etc. The backend handles the API calls to OpenAI for image analysis, and KlingAI is used for image-to-video. Not using the KlingAPI directly though as this is too expensive for me to use in a hobby project, instead using PiAPI.

Thanks!

Re: Show HN: I made a web app to bring children's drawings to life

#74

Post by lolptdr »

vikmex wrote: post #7
j_french wrote: post #5

Looks interesting, but it would be nice to be able to try it out (once even) without subscribing. The one token that seems to be available when you create an account disappears when you try to create an animation

Hi, sorry for your troubles. It should be possible to try for free, looks like I have a bug after you submit the drawing, but it should still be visible under "History"

Hmm, I don't see any free token. I agree that one free token is a good way to get interest going.

Re: Show HN: I made a web app to bring children's drawings to life

#75

Post by vikmex »

solardev wrote: post #67

The free plan still doesn't work. I never submitted anything. Was login gated, then forced to sign up with Google, then brought to the dashboard with 0/0 tokens, no way to submit anything, and nothing in the history. Too bad. Wanted to show this off to a nephew.

Hi,

Sorry, had to stop the free plan for now. The traffic got so high I was unable to sustain the cost myself of letting everyone do free testing.

Re: Show HN: I made a web app to bring children's drawings to life

#77

Post by solardev »

vikmex wrote: post #75
solardev wrote: post #67

The free plan still doesn't work. I never submitted anything. Was login gated, then forced to sign up with Google, then brought to the dashboard with 0/0 tokens, no way to submit anything, and nothing in the history. Too bad. Wanted to show this off to a nephew.

Hi, Sorry, had to stop the free plan for now. The traffic got so high I was unable to sustain the cost myself of letting everyone do free testing.

Understandable. Thanks for the response! In that case, a few more screenshots or videos of the process would be nice.

Re: Show HN: I made a web app to bring children's drawings to life

#78

Post by batchku »

Hi Victor!

I love this. I've been playing around with drawing-to-animation techniques for a long time (check out this playlist of videos from my lab at CMU from 9 years ago: https://www.youtube.com/watch?v=Uv0qX7N2sJw&list=PLLhv4FQp7z...).

I gave your system a try and it's wonderful. The quality of animations are very different than what you get from rigged rag-dolls.

There are pros and cons to these approaches; the nice thing about masking/cropping/rigging (as our old "Dranimate" system did and Meta's "Animated Drawings" does) is that you prepare once, and then you can animate as many times in as many different ways as you want; you can drive it with mocap data; or with real-time inputs as with the videos of Dranimate above). The bad thing is that the first time preparation takes time.

I can see a lot of magic emerging from the combination of the two. I have recently gotten deep into this again (becauase now we have two little ones that are drawing all the time, and we started a Preschool in coastal norcal so kids are all around and this sort of magic really works on them, IRL).

I would love to connect with you sometime if you are up for chatting. Maybe there is a there there.

Re: Show HN: I made a web app to bring children's drawings to life

#79

Post by vunderba »

batchku wrote: post #78

Hi Victor! I love this. I've been playing around with drawing-to-animation techniques for a long time (check out this playlist of videos from my lab at CMU from 9 years ago: https://www.youtube.com/watch?v=Uv0qX7N2sJw&list=PLLhv4FQp7z... ). I gave your system a try and it's wonderful. The quality of animations are very different than what you get from rigged rag-dolls. There are pros and cons to these approaches; the…

You didn't do anything wrong - Kling can occasionally return a static result particularly for 2D images. It might have been the "grid lines" but Kling's model is effectively a black box.

https://kling.kuaishou.com/en

Side note: Nice video - setting up the rigging mesh reminds me of the "puppet warp" deformation system in Adobe Photoshop.

@Vic:

Bit of advice, you need to build some kind of a static checker (either in terms of the total compressed size of the video - very small file sizes likely indicate a failed gen, or in terms of a hash as a measure of frame-to-frame changes) - to help set up an automated appeals for customers... having to manage this on a case-by-case basis will destroy any enthusiasm you might have for this project.

Re: Show HN: I made a web app to bring children's drawings to life

#80

Post by umeshunni »

vikmex wrote: post #39
indoor47 wrote: post #16

Didn’t work for me.. animation just had some camera scroll, but figures remained static

Unfortunately it might struggle in some cases depending on what your drawing portrays, how you took the photo of the image as well as the description you provided.

Yeah I had the same issue for the 2 pictures I tried.
Post reply on HN