Google researchers detail new method for upscaling low-resolution images
1–10 of 13 posts
Re: Google researchers detail new method for upscaling low-resolution images
#2It is pretty impressive/crazy how well CDM and SR3 work together to go from 32x32 to 256x256 e.g. the Irish Setter. How could the algos possibly know the lighter coloring (due to breed or lighting) between the dog's eyes?! It's basically inventing pixels
Re: Google researchers detail new method for upscaling low-resolution images
#3Some of the images in the article seemed to be high-res images that where downscaled to low-res (and it makes sense to see how the upscalling process changes the original), but wouldn't that make it easier for the ML to revert the downscaling process rather than taking an original low-res photo and upscale it?
Re: Google researchers detail new method for upscaling low-resolution images
#4If we start with multiple source images that are "small" (by some definition of small) perturbations of each other and upscale them, what can be said about the results?
Re: Google researchers detail new method for upscaling low-resolution images
#5We changed the URL from https://petapixel.com/2021/08/30/googles-new-ai-photo-upscal..., which points to this. Both articles point to this one, which had a recent and related thread:
High Fidelity Image Generation Using Diffusion Models - https://news.ycombinator.com/item?id=27858893 - July 2021 (19 comments)
Re: Google researchers detail new method for upscaling low-resolution images
#6[deleted]
Re: Google researchers detail new method for upscaling low-resolution images
#7It is pretty impressive/crazy how well CDM and SR3 work together to go from 32x32 to 256x256 e.g. the Irish Setter. How could the algos possibly know the lighter coloring (due to breed or lighting) between the dog's eyes?! It's basically inventing pixels
How confident can you be that the initial 32x32 was an Irish Setter?
Re: Google researchers detail new method for upscaling low-resolution images
#8Some of the images in the article seemed to be high-res images that where downscaled to low-res (and it makes sense to see how the upscalling process changes the original), but wouldn't that make it easier for the ML to revert the downscaling process rather than taking an original low-res photo and upscale it?
This is true. Downscaling an image and then training a neural network to scale it back up is the way single-image superresolution systems typically work.
Research papers need to evaluate their models, and how can you evaluate a scaled-up image unless you have the original ground truth to compare it to?
This can introduce a dataset shift bias. For example, if you train a network to upscale 1080p movie frames to 4k, the results might be disappointing when you try to scale 4k to 8k.
Re: Google researchers detail new method for upscaling low-resolution images
#9It is pretty impressive/crazy how well CDM and SR3 work together to go from 32x32 to 256x256 e.g. the Irish Setter. How could the algos possibly know the lighter coloring (due to breed or lighting) between the dog's eyes?! It's basically inventing pixels
Even basic upscaling algorithms can guess a surprising amount of detail.
When I was putting together a simple and fast method, a while back, I compared my own to the very, very, basic and ended up with this [0].
The far left is the original, the others are just shifting the scale percentage. There's a surprising amount of detail kept, even though all of the algorithms were pushed way beyond what should be considered their limits. (Purposefully - to expose bias that was easier to analyse.)
[0] https://raw.githubusercontent.com/shakna-israel/upscaler_ana...
Re: Google researchers detail new method for upscaling low-resolution images
#10There might be hope for Star Trek:Deep Space Nine yet!