Neural Networks do not think. They perform a series of computations, and arrive at a result. It is not intelligence. It is a very useful tool for solving problems that can be quantified and that we can generate a lot of data from, but ultimately, it is still human intelligence that is interpreting the problem and result.
Artificial Intelligence Is Already Weirdly Inhuman
31–40 of 84 posts
Re: Artificial Intelligence Is Already Weirdly Inhuman
#32I do have my doubts that plain neural networks will ever be able to achieve conceptual understanding. I have an affinity for classical, rational AI in that you can correct it and it will take that correction and instantly apply it to is knowledge base. It can also explain why it came to a conclusion. (though obviously this style has its very real limitations) NNs and other current statistical/connectionist approaches…
To my mind, that's EXACTLY how humans do it. A baby is not instructed, "it has 2 legs, feathers, and is tall, therefore it is an ostrich", there's quite a bit more "LOOK OSTRICH /present input of ostrich/" prior to the point of being able to generate any justification.
As sister posts have pointed out, I tend to believe that the ability to justify the classification is another learned skillset that comes later developmentally, the ability for higher primates (and babies) to perform classification without the (as far as I know) ability to do the higher order reasoning lends itself to this theory.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#33(My take on this problem, feel free to correct any assumptions I make that are wrong) I think this is because neural nets are not actually "intelligent" in terms of the commonly accepted definition of intelligence. They are dumb. They try, usually with simple probabilistic techniques and input element-wise transforms, to mimic some function that produces approximations for a given set of inputs and outputs. The train…
> They try, usually with simple probabilistic techniques and input element-wise transforms, to mimic some function that produces approximations for a given set of inputs and outputs It's my understanding that this is basically how the brain works. My personal theory is that enough of these "dumb" inputs, wired correctly together, leads to emergent behavior that is consciousness.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#34(My take on this problem, feel free to correct any assumptions I make that are wrong) I think this is because neural nets are not actually "intelligent" in terms of the commonly accepted definition of intelligence. They are dumb. They try, usually with simple probabilistic techniques and input element-wise transforms, to mimic some function that produces approximations for a given set of inputs and outputs. The train…
> They try, usually with simple probabilistic techniques and input element-wise transforms, to mimic some function that produces approximations for a given set of inputs and outputs It's my understanding that this is basically how the brain works. My personal theory is that enough of these "dumb" inputs, wired correctly together, leads to emergent behavior that is consciousness.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#35Sigh. The phrase "neural network" is getting tossed around these days with some type of sensationalist flair, an almost romanticized notion of this impending explosion of super-human phenomena. As Alex Smola says with much frustration in one his classes, "it's only math!" It's a fancy term for straightforward mathematics. Bloggers are so often making them out to be much more than they are.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#36I do have my doubts that plain neural networks will ever be able to achieve conceptual understanding. I have an affinity for classical, rational AI in that you can correct it and it will take that correction and instantly apply it to is knowledge base. It can also explain why it came to a conclusion. (though obviously this style has its very real limitations) NNs and other current statistical/connectionist approaches…
At the risk of nitpicking, I'm going to specifically address your statement of "It feels like an ostrich" To my mind, that's EXACTLY how humans do it. A baby is not instructed, "it has 2 legs, feathers, and is tall, therefore it is an ostrich", there's quite a bit more "LOOK OSTRICH /present input of ostrich/" prior to the point of being able to generate any justification. As sister posts have pointed out, I tend to…
1) He called all birds ducks for the longest time, presumably based on being exposed to a bath duck, and this weird Youtube video about ducks swimming in the water.
2) Then he called some of them bird, based on being exposed to a bath toy bird.
3) Then he split them up a bit more... parrot, chicken, rooster, etc. He started seeing them in books and real life.
4) At no point could he explain the difference. Still can't.
5) And he definitely thinks the only difference between a rooster and a chicken is colorful feathers.
6) And he's not quite sure about ducks and geese, but usually gets it right.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#37I do have my doubts that plain neural networks will ever be able to achieve conceptual understanding. I have an affinity for classical, rational AI in that you can correct it and it will take that correction and instantly apply it to is knowledge base. It can also explain why it came to a conclusion. (though obviously this style has its very real limitations) NNs and other current statistical/connectionist approaches…
I'm a firm believer that it's a mistake to ask machines to do X in the hope that they'll do Y. We can't train an ANN to classify images then ask it to explain its reasoning; that's not the task we trained it for! How might we train an ANN to explain its reasoning? One approach would be to learn programs: have the ANN write programs which classify images. Then we have a classifier (run the program) and an explanation…
It is very easy to take a picture of a car and tell a computer what it is, not so easy to write a program and explain to a computer what it does.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#38I do have my doubts that plain neural networks will ever be able to achieve conceptual understanding. I have an affinity for classical, rational AI in that you can correct it and it will take that correction and instantly apply it to is knowledge base. It can also explain why it came to a conclusion. (though obviously this style has its very real limitations) NNs and other current statistical/connectionist approaches…
We are capable of conceptual thinking because we can think about our own thoughts, and further think about our own thoughts about our own thoughts, etc, in an endless cascade of meta-thinking (which is in fact what thinking is). The ability to experience a gestalt, and the ability to think about it, are two major steps. We seem to have achieved the first, with current NNs. That's pretty amazing already!
I think the ability to be pointed at itself is a necessary step for those NNs to develop self-consciousness and, thereby, conceptual understanding. We're not there yet, for sure, but how much further are we? A few years? A decade? A few decades? The latter is no doubt a very pessimistic estimate (conservative AI researchers agree on this).
Human-style intelligence is certainly not here yet. But it is almost certainly just around the corner.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#39I do have my doubts that plain neural networks will ever be able to achieve conceptual understanding. I have an affinity for classical, rational AI in that you can correct it and it will take that correction and instantly apply it to is knowledge base. It can also explain why it came to a conclusion. (though obviously this style has its very real limitations) NNs and other current statistical/connectionist approaches…
At the risk of nitpicking, I'm going to specifically address your statement of "It feels like an ostrich" To my mind, that's EXACTLY how humans do it. A baby is not instructed, "it has 2 legs, feathers, and is tall, therefore it is an ostrich", there's quite a bit more "LOOK OSTRICH /present input of ostrich/" prior to the point of being able to generate any justification. As sister posts have pointed out, I tend to…
If we've only seen automobiles, then all of a sudden are introduced to trains, 18-wheelers, motorcycles, etc, we are challenged to conceptually organize and discover the differences between these classifications. There's still a fair amount of "feel" in weird overlap cases, but the conceptual distinction is created after the fact. There is no mechanism for that in NNs.
Re: Artificial Intelligence Is Already Weirdly Inhuman
#40Earlier quoted context omitted.
At the risk of nitpicking, I'm going to specifically address your statement of "It feels like an ostrich" To my mind, that's EXACTLY how humans do it. A baby is not instructed, "it has 2 legs, feathers, and is tall, therefore it is an ostrich", there's quite a bit more "LOOK OSTRICH /present input of ostrich/" prior to the point of being able to generate any justification. As sister posts have pointed out, I tend to…
I find how my two-year old classifies birds to be amusing: 1) He called all birds ducks for the longest time, presumably based on being exposed to a bath duck, and this weird Youtube video about ducks swimming in the water. 2) Then he called some of them bird, based on being exposed to a bath toy bird. 3) Then he split them up a bit more... parrot, chicken, rooster, etc. He started seeing them in books and real life.…