How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
[deleted]
Deep image prior 'learns' on just one image
11–20 of 235 posts
Re: Deep image prior 'learns' on just one image
#12How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
It doesn't guess "correctly" at all. Zoom in on the image, and focus on the filled-in areas, they look really blurry. It just doesn't look very bad from a birds-eye view.
Re: Deep image prior 'learns' on just one image
#13This is as close to magic as humanly possible.
Re: Deep image prior 'learns' on just one image
#14How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
It cannot know, but it can extend what’s around it to something that “looks believable”. I don’t fundamentally think it is different from asking an artist to complete the image. You’ll get an image, but no actual information about what was under the white.
Re: Deep image prior 'learns' on just one image
#15Red Dwarf - "Uncrop" - http://www.dailymotion.com/video/x2qlmuy
Actually... How cool would it be to have an NN that could extend an image's background with plausible scenery? Not just photoshop 'smart' fill, but for example if it detected a building on the right side of an image, it could draw the rest of it? :)
Re: Deep image prior 'learns' on just one image
#16i find it impressive how it placed a lamp over the library window. After that i was expecting a vase with flowers to be placed on the table in the next, palace shot :)
could you highlight which part this is ?. I think it can only fill in patterns that already exist in the image. I see a big artifact over the window but no lamp.
Re: Deep image prior 'learns' on just one image
#17This is as close to magic as humanly possible.
Why? A human could do better on most of those examples using paint and brush. Look at that bookstore image. If you actually look at it you will see it is quite fucked up.
If a basic human skill done for millennia is magic then that’s a pretty low bar.
Re: Deep image prior 'learns' on just one image
#18How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
It doesn't it repeats/generates pixels that minimize E, so the behaviour heavily depends on the choice of E. for inpainting E is the difference between their generated x and the true x but they mask out the error in the white areas. The model gets good results by just copying nearby pixels.
Re: Deep image prior 'learns' on just one image
#19How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
It doesn't guess "correctly" at all. Zoom in on the image, and focus on the filled-in areas, they look really blurry. It just doesn't look very bad from a birds-eye view.
Probably this is a consequence of least-squares training; the 'average' solution is extremely unlikely.
Re: Deep image prior 'learns' on just one image
#20How can it possibly know what was in the white areas of the library? Is there a residual image? Seems impossible that it guesses correctly.
It doesn't guess "correctly" at all. Zoom in on the image, and focus on the filled-in areas, they look really blurry. It just doesn't look very bad from a birds-eye view.
Somewhat similar to content aware fill in Photoshop [0]. The untrained network can latch onto frequent patterns and match them to holes in the data.
Why doesn’t it paint everything white? Are these actually transparent images or are they somehow tagged?
[0]https://helpx.adobe.com/photoshop/using/content-aware-patch-...