Interesting! If nowadays, pictures are colorized by hand in photoshop, it wouldn't be practical to colorize a full black and white movie. I guess this deep learning approach would solve this problem and colorize old black and white classic movies.
Agreed. I imagine this has applications in compression as well. You could stream a movie (or a football game) in black and white and enable each device to color it on the spot. A similar technique could also be done for HD/3D/VR.
Colorizing black and white photos with deep learning
21–30 of 52 posts
Re: Colorizing black and white photos with deep learning
#22Do an image search for "D-Day in color" and try to tell me which results are original color negatives and which are colorizations made by teenagers.
I'm also a little confused as to why colorizations always aim to restore color to the equivalent of a faded color negative, with muted tonality and grain. Human logic is funny.
Re: Colorizing black and white photos with deep learning
#23The averaging problem in colorization is interesting. If it learns that an apple can be red, green and even yellow - how does it know how to color it? A HN user in an earlier thread suggested to use a fake/real colorization classifiers as a loss function. [1] But I still feel that it would not solve the averaging problem. It would hop between different colors and probably converge to brown. I haven’t come across a pl…
Re: Colorizing black and white photos with deep learning
#24As a professional photo editor and historian, colorized photos really agitate me. I'm all for the creation of new ways to get people to engage with historical primary documentation, but the nuance that these colorizations are interpretations gets lost immediately. Do an image search for "D-Day in color" and try to tell me which results are original color negatives and which are colorizations made by teenagers. I'm al…
I always assumed that if you tried to use "full color" it would look weird, since the photos themselves usually are quite faded and grainy.
Re: Colorizing black and white photos with deep learning
#25The averaging problem in colorization is interesting. If it learns that an apple can be red, green and even yellow - how does it know how to color it? A HN user in an earlier thread suggested to use a fake/real colorization classifiers as a loss function. [1] But I still feel that it would not solve the averaging problem. It would hop between different colors and probably converge to brown. I haven’t come across a pl…
Alternatively, use a discrete colour space and consider colours as categorical data not implying any ordinal scale.
Re: Colorizing black and white photos with deep learning
#26Earlier quoted context omitted.
Agreed. I imagine this has applications in compression as well. You could stream a movie (or a football game) in black and white and enable each device to color it on the spot. A similar technique could also be done for HD/3D/VR.
Yes, you provide a handful of full data keyframes and reconstruct the details of the stream from the middle out.
Re: Colorizing black and white photos with deep learning
#27As a professional photo editor and historian, colorized photos really agitate me. I'm all for the creation of new ways to get people to engage with historical primary documentation, but the nuance that these colorizations are interpretations gets lost immediately. Do an image search for "D-Day in color" and try to tell me which results are original color negatives and which are colorizations made by teenagers. I'm al…
I'm also a little confused as to why colorizations always aim to restore color to the equivalent of a faded color negative, with muted tonality and grain. Human logic is funny. I always assumed that if you tried to use "full color" it would look weird, since the photos themselves usually are quite faded and grainy.
To the grandparent: people have been trying to colorize black and white photos since the 1840s; complaining isn’t going to stop them now, https://en.wikipedia.org/wiki/Hand-colouring_of_photographs
Re: Colorizing black and white photos with deep learning
#28As a professional photo editor and historian, colorized photos really agitate me. I'm all for the creation of new ways to get people to engage with historical primary documentation, but the nuance that these colorizations are interpretations gets lost immediately. Do an image search for "D-Day in color" and try to tell me which results are original color negatives and which are colorizations made by teenagers. I'm al…
Well, as a professional photo editor, you know that if the original b+w photo captures an image with say, a 50% grey value, you don't know if the original color was bright red, or closer to that 50% gray. Bright red has a much higher chroma value, but chroma isn't recorded in a b+w photo - color saturation is lost. Easily demonstrated by making an image in your favorite image editing program that's just straight up red, then changing the image mode to grayscale, then asking someone else entirely to guess the original color.
That, and I think the style is to mimic hand tinting photographs, where you would paint right on a b+w photo. The colors would look "faded" because whatever was used to tint the photograph needed to have a transparent medium, for the information of the photograph itself to shine through. That, and there's just so many colors you could use when hand-tinting. Back to our 50% gray. What if that was... bright yellow? You can't tint "bright yellow" onto a 50% gray area of a photograph. Yellow is highly transparent, and the grey would be too powerful to let its chroma value shine through.
Re: Colorizing black and white photos with deep learning
#29Earlier quoted context omitted.
I'm also a little confused as to why colorizations always aim to restore color to the equivalent of a faded color negative, with muted tonality and grain. Human logic is funny. I always assumed that if you tried to use "full color" it would look weird, since the photos themselves usually are quite faded and grainy.
More than that, it would look weird because restoring the color to a photo in a way that looks plausibly photorealistic is really hard. If you make something more stylized, the viewer doesn’t have as much reference to compare and realize that there’s something wrong. To the grandparent: people have been trying to colorize black and white photos since the 1840s; complaining isn’t going to stop them now, https://en.wik…
True. But there was also tons of skepticism in the medium throughout the mid- to late 1800s. Oliver Wendell Holmes' writing on veracity of photography is a neat reminder that it took the public decades to come to terms that the photographic process was a somewhat-veritable facsimile of "real" life.
Re: Colorizing black and white photos with deep learning
#30As a professional photo editor and historian, colorized photos really agitate me. I'm all for the creation of new ways to get people to engage with historical primary documentation, but the nuance that these colorizations are interpretations gets lost immediately. Do an image search for "D-Day in color" and try to tell me which results are original color negatives and which are colorizations made by teenagers. I'm al…
I'm also a little confused as to why colorizations always aim to restore color to the equivalent of a faded color negative, with muted tonality and grain. Human logic is funny. Well, as a professional photo editor, you know that if the original b+w photo captures an image with say, a 50% grey value, you don't know if the original color was bright red, or closer to that 50% gray. Bright red has a much higher chroma va…