Live data from Hacker News

Show HN: Movie Iris - Visualizing Films Through Color Extraction

github.com

21–30 of 44 posts

Re: Show HN: Movie Iris - Visualizing Films Through Color Extraction

#21
post #20
post #18

Earlier quoted context omitted.

You'll need to install ImageMagick: https://imagemagick.org/script/download.php

I have imagemagick installed, it no longer has a 'magick' command you run montage etc. directly. the problem is globbing that huge amount of files, so I'm wondering if you've tested the commands. >montage >Version: ImageMagick 6.9.11-60 Q16 x86_64 2021-01-25

Ah. Good point. I only tried on a shorter video. Might have to concatenate batches of frames to get around that (much less elegant).

Re: Show HN: Movie Iris - Visualizing Films Through Color Extraction

#22
post #5

I have a cli tool I maintain that finds visually similar images. As a fun experiment several years ago I extracted all the frames of Skyfall and all the frames of the first Harry Potter movie. I then reconstructed Harry Potter frame by frame using the corresponding frame from Skyfall that was most visually similar. The end result was far more indecipherable than I'd ever expected. The much darker color pallet of Harr…

I imagine the best case outcome would look something like Jack Gallant's 2011 work on visual mind reading, where they trained a model on brain activity watching hundreds of hours of YouTube and then attempted to reconstruct a view of video not in the training set by correlating the new brain activity with frames from the input... Sorry I'm not explaining very clearly but there's a YouTube video of the result naturally :)

https://youtu.be/nsjDnYxJ0bo

Learned about this from Mary Lou Jepsens 2013 TED talk, what a throwback

https://www.ted.com/talks/mary_lou_jepsen_could_future_devic...

Re: Show HN: Movie Iris - Visualizing Films Through Color Extraction

#23
post #7

I don't know if this is the "original" (it's a common idea), but here's some "movie barcode" Python code from 9 years ago: https://github.com/timbennett/movie-barcodes

This tumblr was posting these from 2011 to 2018 - moviebarcode.tumblr.com

Re: Show HN: Movie Iris - Visualizing Films Through Color Extraction

#28

This is really cool. I'd love to see this done for the movie "Lola rennt" (Run Lola Run) which is studied for it's color symbolism throughout the film.

Here you are: https://images2.imgbox.com/23/1f/hDNP21e9_o.png

This is using the linked python code - thanks for sharing, OP! - I didn't look into the details but it takes an incredibly long time to save .png files for the source frames despite only selecting 6,400 of them.

Re: Show HN: Movie Iris - Visualizing Films Through Color Extraction

#29
post #11

Here's how to do it with ffmpeg and ImageMagick: ffmpeg -i input.mp4 -vf "scale=1:ih" frames_%04d.png magick montage -mode concatenate -tile x1 frames_*.png "output.png"

Probably want a `-vf fps=1/n` in there (where n = number of seconds) to trim the film down to a manageable number of frames.

(you'd ideally do some "clever" processing to combine a number of frames into a single colour strip but that's obviously more faff than just a simple `ffmpeg` call...)

Post reply on HN