Live data from Hacker News

Deep image prior 'learns' on just one image

dmitryulyanov.github.io

141–150 of 235 posts

Re: Deep image prior 'learns' on just one image

#141

Earlier quoted context omitted.

That's something different: a demonstration of an "inpainting" problem. The black pixels were specifically marked as corrupt. Also, the pattern on the cloth is much less granular than noise.

still the problem space is greatly reduced - all we need now is a nn to detect corrupted pixels

We need more than just the information where corrupted pixels are.

For example, consider an image of a woman, severly blurred such that her individual fingers cannot be discerned but you can still see that it's a woman. A "learned" context-aware approach can now deduce that the "blob" that is her hand should be inpainted by fingers. A non-learned approach can't do that.

Re: Deep image prior 'learns' on just one image

#142

Earlier quoted context omitted.

There is some pretty strong evidence for this: all the toddlers in the world. You only need to show them something once and they'll immediately be able to recognize more examples of the same thing from different angles and even when it is partially hidden. All they have to guide them is the structure of their brains, not the quantity of data they have been exposed.

Seems like this view gets told every once in a while by someone who clearly hasn't been around any 0-2 year olds.

Your comment is hilariously wrong. Please do not make assumptions like this, you're typically going to be embarrassed.

Re: Deep image prior 'learns' on just one image

#143
post #132

Earlier quoted context omitted.

> Line up all the things in the universe that are intelligent. They are all conscious. The words “intelligent” and “conscious” are not sufficiently well defined to make that claim. By “intelligence”, do you mean: 1) “the ability to learn or understand or deal with new or trying situations”? Even current AI can do that. 2) “the ability to apply knowledge to manipulate one’s environment”? That’s another rabbit hole its…

> Even current AI can do that. No it can't. A machine's output is not deterministic from its input and can be sensitive to conditions not anticipated at-programming-time. That isn't understanding. A spinning top may spin on many surfaces not anticipated by the designer and acquire all sorts of interesting behaviors by doing so. "The opposite of consciousness" is not a meaningful criterion of interest. I'm not even su…

> Even current ("real") intelligence can do that.

No it can't. A biological creature's output is not deterministic from its input and can be sensitive to conditions not anticipated at-programming-time. That isn't understanding.

A spinning top may spin on many surfaces not anticipated by the designer and acquire all sorts of interesting behaviors by doing so.

[...]

Many of these tests you're outlining aren't relevant to the question "does this biological creature have what we are interested in". Ie., "is this piece of lead actually gold". Not "is it shiny with a brass coating" -- but can it participate in all the causal interactions gold can. I'm not concerned with how good the tool is, or how close we are to fooling people, i'm concerned with whether the biological creature can think.

Does the biological creature posses any concept? Any idea? Any understanding?

No, only metaphorically. It seems as-if it does to people who use it to aid in their understanding. It is only a trick, no more than the sun being ascribed agency by ancient human being.

Intelligences which we're targeting do not possess concepts. They are not meaningfully connected to their environment. They don't understand it. The dog's finding its bone is just the same as the spinning top find its grove. The spinning is only much more intricate, and the nature of and interaction with the surface much less easily understandable.

The dog experiences illusions of thoughts, concepts, ideas, imagination (and many other things besides) that are about its environment. Those have been caused by the nature of its environment. The spinning top topples towards its final point as-if it understood, just like the dog.

Biological creatures are rivers of biochemical and electrical currents that topple toward and outcome that it sensitive to their current state, like a top spinning about a board. They have no active, navigating, motivated concernful goal-directed action.

My view is that they never will, since on all the best evidence, skillful concernful action does not exist. It is merely illusions that emerge from chemical and electrical interactions.

It is not obviously clear whether your argument is any more valid than the above (or the other way around).

To expand, if a robot in every imaginable way behaves exactly like another human would, how can you know know that one possesses "intelligence" (or rather, consciousness), while the other doesn't?

Why would it be possible to construct the high level structures from which intelligence emerges on top of one set of primitives (electrical/chemical in biological context), and not the other (electrical-based logic on silicon).

The argument you pose have many signs of being an appeal to the ghost in the machine.

For anyone interested in exploring ideas around (self)consciousness and the mind, The Mind's I by Douglas Hofstadter and Daniel C. Dennett is a good read.

Re: Deep image prior 'learns' on just one image

#146
post #21

Wow: "In this work, we show that, contrary to expectations, a great deal of image statistics are captured by the structure of a convolutional image generator rather than by any learned capability. This is particularly true for the statistics required to solve various image restoration problems, where the image prior is required to integrate information lost in the degradation processes. To show this, we apply untrain…

Can someone explain this in a way so that an ordinary mortal computer scientist can understand it?

> Can someone explain this in a way so that an ordinary mortal computer scientist can understand it?

I'll try.

Instead of the common approach that tries to search for image pixels to minimize e.g. a denoising objective, they realize that they can instead search for the weights of an image generator network such that the generated image matches the objective.

They argue that the structure of the network then constitutes some prior knowledge over what a natural image should look like.

My (probably wrong) interpretation: since a convolutional neural network essentially works by looking for some spatial patterns at different resolutions, their optimization process boils down to finding the high and mid-resolution patterns that best match the input image, and then re-using that information to fill in the missing information (or replacing "noise" that does not match the extracted pattern).

Re: Deep image prior 'learns' on just one image

#147

Earlier quoted context omitted.

still the problem space is greatly reduced - all we need now is a nn to detect corrupted pixels

We need more than just the information where corrupted pixels are. For example, consider an image of a woman, severly blurred such that her individual fingers cannot be discerned but you can still see that it's a woman. A "learned" context-aware approach can now deduce that the "blob" that is her hand should be inpainted by fingers. A non-learned approach can't do that.

But the fingers it draws will be random fingers. Not her fingers.

Re: Deep image prior 'learns' on just one image

#148
post #32

Earlier quoted context omitted.

Thanks. I'm not mixing them up! I'm just wondering whether and to what degree architecture , i.e., network structure, will prove important for other, more advanced AI tasks, including up to AGI.

To throw a dissenting voice into the mix: I do not think intelligence is a consequence of structure. Transparency is a consequence of how light interacts with objects. There is no "transparent gold". And being transparent is not something we can program gold to do. Programming is the application of an electric field across a silicon surface: this can no more transmute silicon into gold as it can into a nervous system…

Where do you think human consciousness comes from?

Re: Deep image prior 'learns' on just one image

#149
post #21

Wow: "In this work, we show that, contrary to expectations, a great deal of image statistics are captured by the structure of a convolutional image generator rather than by any learned capability. This is particularly true for the statistics required to solve various image restoration problems, where the image prior is required to integrate information lost in the degradation processes. To show this, we apply untrain…

Since a convolutional network applies parameters (filters) to different parts of an image evenly, this means that this approach still learns, except not from a corpus of images, but from the image itself (i.e. one part of the network learns from different parts of the image).

> This makes me wonder whether and to what degree the structure of the brain's connectome might be a necessary prior for AGI.

Convnets have been invented to speed up learning (reusing parameters). The human brain (afaik) doesn't contain such speedup. Instead it relies on massive parallellism of neurons, and thus trains all "filters" separately instead of reusing them. Therefore, I suppose this approach would not apply to humans.

Re: Deep image prior 'learns' on just one image

#150
post #21

Wow: "In this work, we show that, contrary to expectations, a great deal of image statistics are captured by the structure of a convolutional image generator rather than by any learned capability. This is particularly true for the statistics required to solve various image restoration problems, where the image prior is required to integrate information lost in the degradation processes. To show this, we apply untrain…

Can someone explain this in a way so that an ordinary mortal computer scientist can understand it?

There exist neural network structures that can solve the image processing problems shown when weights are randomly applied.

This means that for these problems the solution is encoded entirely in the network structure and not the weights.

We could use linear regression as an analogy: y = b f(x).

This is akin to saying that for some class of problems, it's the case that you can get as good of a solution from the function you pick alone (x^2, log(x)) as you could from picking a function and then computing the best coefficient. Note this isn't true for linear regression for any meaningful problems, but I feel like it's a decent analogy.

Post reply on HN