Live data from Hacker News

Artificial Intelligence Generates Christmas Song from Holiday Image

news.developer.nvidia.com

111–115 of 115 posts

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#111
post #108

Earlier quoted context omitted.

> I have no reason to believe we will ever have truly thinking, sentient computers Unless you think human brains work on magical pixie dust, I'd say you have quite a few reasons.

I'm not even convinced that the human brain can be modeled in terms of a Turing machine. How does does the brain achieve free will - the ability to "decide" between two arbitrary, equally-weighted things? RNG? And yet, it doesn't "feel" random.

Firstly, free will isn't what you think it is. A random choice might seem "free" but it's not "willed" in any meaningful sense. So let's leave aside the free will question because that term is pretty much undefined at this point.

What your post sort of hints is what's known as the hard problem of consciousness. I recommend reading the Wikipedia pages on it and qualia if you're interested.

Suffice it to say, given our current understanding of physics, we are no better than finite state automata (see the Bekenstein Bound). The only escape from this inevitability is if we collectively decide that the hard problem of consciousness is irreducible, and then something like panpsychism becomes preferable.

This is unlikely though, and we've been through this once before in the debate over how living matter differs from non-living matter. Must there be some "secret sauce" added to non-living matter to bring it to life? This was the proposal of vitalism, but eventually biology came to prominence and all of those who insisted living matter had to be different just died off and we were left once again with a reducible, mechanistic understanding of living matter. So it will be with consciousness (see [1] for an example of how this might work).

[1] http://journal.frontiersin.org/article/10.3389/fpsyg.2015.00...

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#112

Earlier quoted context omitted.

I don't think you are correct from an information computation point of view. When looking at the computation done by neurons in the brain it is sufficient to abstract away the lower-level substrate in which it occurs. You and other posters are all correct regarding the huge volume of information on which human minds are trained. it's hardly unsupervised learning either :) --------- EDIT: In response to your comment,…

> (This is a bit of a stretch as it's not possible to deduce the laws of the universe rigorously.) Not sure I agree. This is known as the problem of induction, and Solomonoff tackles it quite well I think.

Certainly it is not possible to deduce every law governing the Universe! For example posit there is source code for the Universe; then assume a second Universe that is identical except its source code differs in that after 35 billion years suddenly something happens - but since there is no way to investigate the laws directly, nobody inside could possible "deduce" the complete set of laws, there is no way to know that the source code contains a check that gets tripped after 35 billion years. Since only one of the two versions is the one running the universe, but it is not possible to determine which one, therefore the inhabitants of the Universe cannot deduce the laws that govern them: for the first 35 bn years the two universes are bit for bit identical.

So if I wanted to assume there is a one hundred megabyte source code that somehow was actually exactly the source code governing the entire Universe, I'd have to assume that axiomatically. We could never "deduce" it and know for certain that it is the only possible source code and our Universe must be following exactly it and nothing else.

At least, this is my thinking...

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#113
post #109

Earlier quoted context omitted.

I'm curious if this is in spite of you being on board that "sure, server farms do more than enough computation for parity with the human brain" or whether you don't consider neural nets in relation to human neural nets (biological brains)? If you do consider and admit that computationally there seems to be enough horsepower there, where does your skepticism come from that anybody would figure it out? Alternatively, d…

I'm skeptical because you are promising the moon, and when I look and weigh the tech for myself it seems many orders of magnitude less advanced than your hype leads one to believe.

I am basing the promise bottom-up, based on how many neurons are in the human brain, their connectedness and speed, and amount of computation those 3 pounds can be doing using the synaptic mechanisms we know about.

You are basing your skepticism top-down based on the results the science of artificial intelligence has shown to date.

It's a fair source of skepticism. There are 15,000+ species of just mammals, all of which have neural nets and exactly one of which have higher abstract reasoning communicated in a language with very strong innate grammatical rules - and that is humans.

However, we have 7 billion working specimens, a huge digital corpus of their cultural output, and their complete digitized source code which can be explored or modified biologically.

For me bottom-up wins. We can just try things until it works - which may be sudden/overnight.

At the moment I see a jet engine, feathers flying everywhere, and no flight. But looking at that jet engine, I just can't imagine it will take long.

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#114

Earlier quoted context omitted.

> (This is a bit of a stretch as it's not possible to deduce the laws of the universe rigorously.) Not sure I agree. This is known as the problem of induction, and Solomonoff tackles it quite well I think.

Certainly it is not possible to deduce every law governing the Universe! For example posit there is source code for the Universe; then assume a second Universe that is identical except its source code differs in that after 35 billion years suddenly something happens - but since there is no way to investigate the laws directly, nobody inside could possible "deduce" the complete set of laws, there is no way to know tha…

You absolutely can deduce those laws, which is what Solomonoff induction does [1]. It's been formally proven to converge on reproducing the correct function in the limit.

> Since only one of the two versions is the one running the universe, but it is not possible to determine which one, therefore the inhabitants of the Universe cannot deduce the laws that govern them: for the first 35 bn years the two universes are bit for bit identical.

Correct, until they're not, at which point you can distinguish them. Until then, you prefer the laws whose axiomatic complexity is lower. It's basically a formalization of Occam's razor.

[1] https://en.wikipedia.org/wiki/Solomonoff's_theory_of_inducti...

Re: Artificial Intelligence Generates Christmas Song from Holiday Image

#115

Earlier quoted context omitted.

Certainly it is not possible to deduce every law governing the Universe! For example posit there is source code for the Universe; then assume a second Universe that is identical except its source code differs in that after 35 billion years suddenly something happens - but since there is no way to investigate the laws directly, nobody inside could possible "deduce" the complete set of laws, there is no way to know tha…

You absolutely can deduce those laws, which is what Solomonoff induction does [1]. It's been formally proven to converge on reproducing the correct function in the limit. > Since only one of the two versions is the one running the universe, but it is not possible to determine which one, therefore the inhabitants of the Universe cannot deduce the laws that govern them: for the first 35 bn years the two universes are b…

I was using deduce as 'arrive at the actual set of laws (the laws 'deduced' perfectly matches reality indefinitely going forward) and know correctly that they must be the actual set currently running the universe.'

In your phrasing, it seems that you would assume this following sentence does not contain a contradiction.

> Alice in the year 23,435,342,435.03453725 correctly deduced all laws governing her Universe and through a clever mathematical trick was able to correctly deduce the state of the universe in the year 24,535,342,450.03453725 (15 years later, i.e. '50 instead of '35), which a mathematical trick allowed her to predict with absolute precision without having to model the entire Universe. Having deduced the correct set of laws, she knew for certain that that state at '50 would include x, let's say atom #349388747374123454984598323423 in that Universe must be a hydrogen atom. She knew this with certainty, because she had deduced the laws governing her Universe and that they could not be any other set of laws. The laws were also deterministic. She was also correct in her calculations. Therefore, since she made no mistake in her calculations, had deduced the correct set of laws which was actually running the Universe, she was correct that atom number #349388747374123454984598323423 would be a hydrogen atom. One thing to note however, is that the whole universe happened to have an "if year ==24,535,342,449 then all atoms turn into nitrogen atoms wherever they may be" which someone had added to the source code as part of an experiment. Therefore, although she had correctly deduced that atom #349388747374123454984598323423 in the year '50 would be a hydrogen atom, in fact when that year rolled around it was not one. That doesn't stop her deduction from being correct and proper, or mean that she had not deduced the laws with certitude or been correct. In effect, it is possible fro me to say with complete and justified certitude that "next year x" as long as I have completely rigorously deducted it, and I will be correct in my rigorous deduction and in thinking that I have 100% chance of being right, even if next year not x."

you see my struggle?

For me, if you "deduce" that something "must" be exactly some way, you can't possibly have been right in your deduction if it turns out that you are wrong.

Nobody can deduce that Pi cannot equal 4, if, in fact, there is any chance that it is indeed 4 (under that axiomatic system). That's not a deduction: it's a logical fallacy.

so you are you using an extremely different definition of "deduction" as I am. I can deduce that within standard axiomatic mathematics, Pi is not equal to 4. After making that correct deduction, there is no conceivable Universe in which I am wrong. (Seriously - it's not possible that in another universe someone exploring ZFC+ would find that Pi is four there.)

Held to such rigor, there is nothing that I can deduce with certainty about the laws that govern our Universe - so that it is impossible that some other laws or a larger set of laws might in fact govern it.

However, that is exactly the state that I wanted to assume as axiomatic for my argument. (I wanted you to assume as axiomatic that the complete set of laws or source code could be 'deduced' and as guaranteed to be correct as we have a guarantee that under ZFC+ pi isn't equal to 4.)

if we knew that "these 100 megabytes exactly model our Universe, and by the way deterministically - if you run it on enough hardware to simulate a hundred billion galaxies with a hundred billion stars, one of them has a human around year 12 billion" and we are guaranteed that it is exactly the laws of our universe with the same certitude that we are guaranteed Pi isn't equal to 4 under ZFC+ -- well --- that is not the level of certitude that Physics is able to confer :)

Post reply on HN