Live data from Hacker News

Butterflow: motion interpolated videos from the command line

github.com

11–20 of 20 posts

Re: Butterflow: motion interpolated videos from the command line

#11
post #4

Earlier quoted context omitted.

iPhone cameras actually record at 120/240fps rather than recording at a lower rate and interpolating. Thank god. I don’t want the soap opera effect on my videos. Interpolation is the first thing I disable on a TV.

On TVs where it's interpolating to convert from 24fps to 60 it usually looks terrible, but slowing down a real 60fps video using motion interpolation usually looks much better, as there's less that needs guessing

Until everybody starts filming at 60/120hz, I am forced to use motion interpolation on my tv, even if it's full or artifacts. I hope it will take less than 50 years for movie technology to advance..

Re: Butterflow: motion interpolated videos from the command line

#14
post #8

Found this cool project (not mine) that uses butterflow for applying motion interpolation to Himawari-8 satellite images: https://github.com/dandelany/animate-earth The final results look really nice https://www.youtube.com/channel/UC6Mlo4zfmEITcNoCpBKfEfg/pla...

I definitely noticed in these videos some color artifacts where red and blue colors bleed for short bursts. Are these inherent to butterflow or specific to this channel?

Re: Butterflow: motion interpolated videos from the command line

#16
post #10

Did anyone try this on hand-drawn animation? How does it look? I'm not optimistic, since usually processes made for live-motion don't work that well, but going from e.g. 8 or 12 FPS to 24 FPS with no manual work would be just amazing.

I haven't, but I have used Butterflow quite a bit and it tends to really break down for frame rates below 24 as well as fast motion, though sometimes it pulls through with the right circumstance. Some clips from really old cartoons might work, but probably not the entire cartoon itself without a lot of trial, error, and editing. Even then, one might be SOL for some parts of it.

One success I had with Butterflow was upping the frame rate on the Apollo moon landing videos. It looked like a home video! lol Unfortunately I left the results on my work computer before I left the company, but with the Docker image of Butterflow and youtube-dl to get the footage, you can experiment yourself.

Re: Butterflow: motion interpolated videos from the command line

#17
post #13

One good application of this tech is old movies with poor frame rates. The WW1 documentary They Shall Not Grow Old uses a technique like this.

I came across Butterflow while trying to smooth out the ragged motion in anime. It didn't work out-of-the-box unfortunately, but there are other similar attempts happening: https://www.youtube.com/watch?v=TvgcCyfVVog

Re: Butterflow: motion interpolated videos from the command line

#18
post #8

Found this cool project (not mine) that uses butterflow for applying motion interpolation to Himawari-8 satellite images: https://github.com/dandelany/animate-earth The final results look really nice https://www.youtube.com/channel/UC6Mlo4zfmEITcNoCpBKfEfg/pla...

Hey cool, that’s my project! Thanks for the shoutout :) happy to answer questions if you’ve got any.

BTW, here's my favorite video - a compilation of the best results with some music: https://www.youtube.com/watch?v=1lPsA8J3U0Q

Re: Butterflow: motion interpolated videos from the command line

#19
post #14
post #8

Found this cool project (not mine) that uses butterflow for applying motion interpolation to Himawari-8 satellite images: https://github.com/dandelany/animate-earth The final results look really nice https://www.youtube.com/channel/UC6Mlo4zfmEITcNoCpBKfEfg/pla...

I definitely noticed in these videos some color artifacts where red and blue colors bleed for short bursts. Are these inherent to butterflow or specific to this channel?

They are artifacts in the data - the different color channels that make up the image are captured at different times, so if there is any movement of the satellite between exposures, or software glitches that only affect one channel, they show up as bleeding colors in the final merged image.
Post reply on HN