Live data from Hacker News

Colorizing and restoring old images with deep learning

github.com

21–30 of 107 posts

Re: Colorizing and restoring old images with deep learning

#21

Earlier quoted context omitted.

it didn't, the tv picture is much more blue (at least to my eyes) than the original.

Even though it's blue it didn't try to colorize the man in the TV picture

couldn't that be that it can't recognize him at all?

Re: Colorizing and restoring old images with deep learning

#22

Earlier quoted context omitted.

Even though it's blue it didn't try to colorize the man in the TV picture

couldn't that be that it can't recognize him at all?

AI smart enough to recognize that a dismembered head would be pale ;)

Re: Colorizing and restoring old images with deep learning

#24
When I saw "restoring" in the title I was expecting higher resolution. For example seeing in modern photo level detail eyelashes, wrinkles, etc. I get that, like the colors, this would require the adding lots of made up information about scene and feature details but IMO it would blur the lines between restoration and reconstruction/storytelling in a really awesome way. Old photos are cool in their own way but their lack of detail makes them seem so alien. Would be exciting to get a hyper real reconstruction.

Are there examples of ML doing something like that? (also know little about ML)

Re: Colorizing and restoring old images with deep learning

#26

Is it just me or do the example images seem overly biased toward coloring clothing as blue?

Well it has to pick something right? Am I wrong in thinking the color, except for very specific known items, is simply lost and can't be inferred by any level intelligence? Maybe the solution is "If I_HAVE_NO_IDEA -> randomColor()" which I realize doesn't jibe with how ML works (does it?)

Re: Colorizing and restoring old images with deep learning

#27
Colorizing single images will always been a bespoke task. There are just too much missing data in the image to be able to create high quality colorizations from the photo alone.

However, I think the real application here is colorizing frames of movies. Imagine being able to turn black and white historical footage into color. It won't be as good looking as a single image, but it would be good enough i bet.

Re: Colorizing and restoring old images with deep learning

#28
post #2

The most interesting exhibit for me is "People watching a television set for the first time", where everything is colorized except the TV image , which correctly remains B&W. I wonder what kind of a training set provided the neural network with this notion.

There's some haze on the original image. I think it simples ignores the hazy portion of an image or attempts a very light colorization which seems to be the case here.

Re: Colorizing and restoring old images with deep learning

#29

Very interesting... seems to basically learn that: Faces -> some variety of flesh-colored from light to dark Fabric/clothing -> blue Sky -> blue Vegetation -> green Wood -> brown Blank -> turquoise or tan Small details -> fascinating variety of colors, but often a brilliant red Which all seems fairly reasonable. For many things (like wood or skin) it seems accurate. Obviously things like clothes come in such a variet…

Like other colorisers I've seen, it does seem to have non-uniform colouring of clothing, with bleed from surrounding areas into clothing being fairly common. That's seems slightly weird, as I am sure few training images would have that.

Re: Colorizing and restoring old images with deep learning

#30
post #11
post #6

This seems almost too good to be true. One thing I find very striking is how it gets skin tones very plausible across people of different ethnicities (though the majority of subjects in the picture appear of european descent). Unless a) my brain is applying more interpretation to these pictures than I realize or b) the author (intentionally or not) picked out pictures that show the best results

Yeah some of the details are absurdly good, especially the picture of the "Texas Woman", how it gets the dogs ears perfect, perfect colors on the apples, and renders the copper pot a perfect copper hue.

Unfortunately her hands are grey. Otherwise, it is very good.
Post reply on HN