Live data from Hacker News

Artificial Intelligence Is Stuck

nytimes.com

141–150 of 189 posts

Re: Artificial Intelligence Is Stuck

#141

> Not long ago, for example, while sitting with me in a cafe, my 3-year-old daughter spontaneously realized that she could climb out of her chair in a new way: backward, by sliding through the gap between the back and the seat of the chair. My daughter had never seen anyone else disembark in quite this way; she invented it on her own — and without the benefit of trial and error, or the need for terabytes of labeled d…

Yes terabytes.... Probably petabytes or more. And all of it is unlabeled data.

If you fed video and sensory data to a deep net for 3 years and somehow were able to come up with an activation function that modeled "survival", I still highly doubt that anything at all would come out that remotely resembles human intelligence. There's no way that i'm aware of to label reality in real time.

Re: Artificial Intelligence Is Stuck

#142
In 1988 Hubert L. Dreyfus and Stuart E. Dreyfus released a paperback version of their previously published "Mind over Machine" book, in which they mostly spend time debunking the myth that expert systems and rule-based programs are ever going to have "intelligence" on par with human brain.

The book is an interesting read in itself, but what I found remarkable is that in the 1988 release they added a "preface to paperback edition" in which they used a couple of pages to give their views on artificial neural networks, which (though not new) was gaining some steam at the time. The conclusions they reached are as relevant now as they were 3 decades ago.

There have been no new breakthroughs in this area. Most of the research being done is in application of what we have known for decades in specific areas, with minor insights into tweaks and uses of combinations of algorithms to better solve specific problems. The big differences between then and now are: (1) technology is more accessible - data is easier to collect, store and output via many input/output methods; and (2) the hardware is significantly faster - we can now go through more data, make algorithms run faster, and appear to perform better.

This inevitably brought a lot of hype, including many predicting human-like artificial intelligence not too far away. But maybe those with experience in 60s and 70s in the field in USA and Japan can draw a parallel between what's happening now and what has happened few times in the past in this area:

- companies perform neat promising demos with unrealistic implicit or explicit promises

- investors pour money in

- media hype ensues

- after awhile - no new breakthroughs: still can't turn ANN or expert system into a human brain

- outcome is improvements in limited use cases

- hype dies down, but we can repeat the cycle after improvements in hardware

Edit: formatting

Re: Artificial Intelligence Is Stuck

#143
post #50

The author is just spouting off on a topic he doesn't understand. It's just a rehashing of Chomsky's hatred of statistical NLP. He pulls off the neat trick of approximating knowledge of artificial intelligence by hoodwinking the New York Times, but he doesn’t have insight into the topic he's talking about.

The author is a tenured professor at one of the best institutions in the world - what do you have to show for yourself?

If you honestly think the author should be discredited because you don't find is PhD appealing, you need to take a step back and seriously readjust your arrogance level.

Re: Artificial Intelligence Is Stuck

#144
Why does everyone assume human intelligence is computable? Seems we should be checking that assumption at this point since we've made so little progress, and a definitive answer is much more valuable than this ongoing speculation.

Re: Artificial Intelligence Is Stuck

#145
post #144

Why does everyone assume human intelligence is computable? Seems we should be checking that assumption at this point since we've made so little progress, and a definitive answer is much more valuable than this ongoing speculation.

Philosophers have been saying this for 60 years Hubert Dreyfus' 1972 book "What Computers Can't Do" is a notable example.

Re: Artificial Intelligence Is Stuck

#146

The article is calling us to teach AI to read words and phrases and look for the meaning, not just a statistical correlation. I put dictionary data into Pingtype English to try to parse phrases instead of just words. e.g. "pick [something] up". The purpose is to do word-for-word translation to Chinese as an educational tool. It's not perfect, but the dictionary is editable. You can contact me if you want to discuss n…

Do you know about Linguée? It's a database of human-translated texts with flexible search by phrase. One of its language pairs is English-Chinese. Reverso is the same idea, but doesn't have Chinese.

Re: Artificial Intelligence Is Stuck

#147
post #79

AI definitely isn't stuck, unless you define it solely as creating artificial general intelligence. The problem there is that we don't understand general intelligence very well at all. Of course the fixed graphical models we use have their own problems. For instance, we can't even effectively model a neural network with a variable number of inputs.

I'm not sure why you think neural networks can't handle variable numbers of inputs. Recurrent networks that ingest whole sequences have been around for a long time, and other structures have their own network topologies. Support for things other than classic RNNs is more limited, but e.g. TensorFlow Fold ( https://github.com/tensorflow/fold ) was specifically designed for that.

RNNs are a good model for things that are naturally sequential with limited state transfer. They are not so elegant for things with no defined ordering and a large amount of shared state.

Re: Artificial Intelligence Is Stuck

#149

Earlier quoted context omitted.

> Look around, most organisms in our world communicate using extremely simple binary language or don't communicate verbally at all. Yes. > Yet, they are intelligent enough to do very complicated tasks which current robots fail to do. True. > Intelligence is an easier problem than language, and thus should be solved before language. Wrong. This is the classic mistake everybody makes, including people in Computer Scien…

> For Nature to learn how to develop a nervous system capable of flexibly interacting with the environment, culminating in our brains, took hundreds of millions of years. Nature never learned anything. Nature is not a force that chooses what features it wants to implement in living things. We evolve in periods of punctuated equilibrium, when the average individual within a population cannot reproduce successfully. Th…

Are you nature? Did you learn? Are you not a force?

It's true nature never "tried" anything except to keep going but I posit it does learn, it's memory is our genes and our own memory, and we are the effect of it's force. I also don't see man and nature as separate. If we created AGI, then nature created AGI. AGI can look back and say the step from biological to machine was akin to single to multi celled organisms.

Re: Artificial Intelligence Is Stuck

#150
post #96
post #60

Earlier quoted context omitted.

well we have the advantage of only copying nature that already works the hardest part is already done the Zero to One. Nost of human technology today is based on replicating nature.

"Based on replicating nature"? Fiber optic cable? Microchips? Mass spectrometers? Atomic weapons? Even humans first technology, sharp stone tools, isn't really a replication of nature. Maybe some examples would help me understand what you mean.

Stone tools is replication of beak and claws.
Post reply on HN