Live data from Hacker News

Noam Chomsky on Where Artificial Intelligence Went Wrong

theatlantic.com

171–180 of 184 posts

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#171

Earlier quoted context omitted.

Chomsky's expertise is in linguistics and political analysis. Stephen Pinker's The Language Instinct is a good, readable introduction to some of Chomsky's work (and the wider field to which he is pivotal.) Chomsky's Manufacturing Consent is probably his classic work of political analysis. http://en.wikipedia.org/wiki/Noam_Chomsky_bibliography He's no quack.

You know in the soft sciences everyone is a quack because fundamentally they don't practice - wait for it - science. Science stops false connections by correctly attributing cause to its respective effect. Social sciences do not. For all intents and purposes, the vast majority of social science is either unreproducible, vague, mixing correlation with causation, uses dependent variables, poorly reasoned, statistical q…

to nitpick:

Everett is very controversial, for example:

Everett (2005) has claimed that the grammar of Pirahã is exceptional in displaying 'inexplicable gaps', that these gaps follow from a cultural principle restricting communication to 'immediate experience', and that this principle has 'severe' consequences for work on universal grammar. We argue against each of these claims. Relying on the available documentation and descriptions of the language, especially the rich material in Everett 1986, 1987b, we argue that many of the exceptional grammatical 'gaps' supposedly characteristic of Pirahã are misanalyzed by Everett (2005) and are neither gaps nor exceptional among the world's languages. We find no evidence, for example, that Pirahã lacks embedded clauses, and in fact find strong syntactic and semantic evidence in favor of their existence in Pirahã Likewise, we find no evidence that Pirahã lacks quantifiers, as claimed by Everett (2005). Furthermore, most of the actual properties of the Pirahã constructions discussed by Everett (for example, the ban on prenominal possessor recursion and the behavior of WH-constructions) are familiar from languages whose speakers lack the cultural restrictions attributed to the Pirahã. Finally, following mostly Gonçalves (1993, 2000, 2001), we also question some of the empirical claims about Pirahã culture advanced by Everett in primary support of the 'immediate experience' restriction. We conclude that there is no evidence from Pirahã for the particular causal relation between culture and grammatical structure suggested by Everett. -- Pirahã Exceptionality: A Reassessment, http://dash.harvard.edu/handle/1/3597237

Pirahã actually has two color terms, 'dark' and 'light', which is Stage I in http://en.wikipedia.org/wiki/Basic_Color_Terms:_Their_Univer..., http://en.wikipedia.org/wiki/Linguistic_relativity_and_the_c...

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#172

Earlier quoted context omitted.

I'm sympathetic to both Chomsky and Open Cog's aims. I know Chomsky is a serious scientist with considerable accomplishment. I have seen totally loony stuff in videos of AGI conferences (Tachyons and stuff). Open Cog may be better than that. But it hasn't proved that it is better than that. The 1970-80's AI involved the Chomskyan paradigm of "draw up a naive design of the mind and/or brain and implement it". That fai…

This is Ben Goertzel... AGI is mainstream science, these days. The keynote of the 2012 AAAI conference (the major mainstream AI research conference each year), by the President of AAAI, was largely about how the time has come for the AI field to refocus on human-level AI. He didn't use the term "AGI" but that was the crux of it. The "AI winter" is over. Maybe another will come, but I doubt it. What's different from 2…

Thank you for you're reply Ben.

I wish you luck (well sort-of - with great power would come great responsibility and all-that).

I wasn't making up the tachyon guy. If I have time, I'll dig the video (it'd be a little hard since the hplus website reorganized). He was presenter and not an audience member, had at least a paper at one of these conferences. I can easily believe the AGI conferences have gotten better.

I would stick to the point that AGI needs to make clear how it will overcome previous problems - clear to mainstream science is useful for funding but clear to yourselves so you have ways to proceed is most important.

I don't necessarily agree exactly with Herb Dreyfus' critique but I think that in the minimum a counter-critique to his critique is needed to clarify how an AGI could work.

A good summary of his argument would be: http://leidlmair.at/doc/WhyHeideggerianAIFailed.pdf

I mean, I have worked in computer vision (not that much even). There's no shortage of algorithms that solve problem X but nothing in particular weds them together. Confronted with a new vision problem Y, you are forced to choose one of these thousand algorithms and modify it manually. You get no benefit from the other 999.

As far as open source methodologies solving the AGI question, I've followed multiple open source projects. While certain things might indeed work well developed using the "bazaar" style, I haven't seen something as exacting a computer language come out of such a process - languages tend to require an individual designer working rather exactly - with helpers certainly but in many, many situations almost alone (look at Ruby, Perl, Python, etc). I would claim AGI would at least exactly as a computer language, possibly more-so. Further, just consider how the "software crisis", the limitations involved in producing large software with large numbers of people, expresses the absence of AGI. Essentially, to create AGI, you would need to solve something like a boot strapping problem so that you cause the intentions of the fifty or five thousand people working together to add up to more than what fifty or five thousand intentions normally add up to in normal software engineer. I suppose I believe some progress on a very basic level is needed to address.

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#173
Chomsky on the lack of progress in AI:

If you take a look at the progress of science, the sciences are kind of a continuum, but they're broken up into fields. The greatest progress is in the sciences that study the simplest systems. So take, say physics -- greatest progress there. But one of the reasons is that the physicists have an advantage that no other branch of sciences has. If something gets too complicated, they hand it to someone else.

If a molecule is too big, you give it to the chemists. The chemists, for them, if the molecule is too big or the system gets too big, you give it to the biologists. And if it gets too big for them, they give it to the psychologists, and finally it ends up in the hands of the literary critic, and so on.

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#174

Chomsky on the lack of progress in AI: If you take a look at the progress of science, the sciences are kind of a continuum, but they're broken up into fields. The greatest progress is in the sciences that study the simplest systems. So take, say physics -- greatest progress there. But one of the reasons is that the physicists have an advantage that no other branch of sciences has. If something gets too complicated, t…

Great quote. Chomsky has an amazing talent for really getting to the heart of issues and framing them in useful and insightful ways.

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#177

Chomsky on the lack of progress in AI: If you take a look at the progress of science, the sciences are kind of a continuum, but they're broken up into fields. The greatest progress is in the sciences that study the simplest systems. So take, say physics -- greatest progress there. But one of the reasons is that the physicists have an advantage that no other branch of sciences has. If something gets too complicated, t…

Great quote. Chomsky has an amazing talent for really getting to the heart of issues and framing them in useful and insightful ways.

I watched 'The manufacture of consent' recently, I had a hard time stopping listening to him. His wording dug right through my skull, very concise yet simple.

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#178
As someone who was familiar with the differences between Chomsky and Norvig (a simplification - maybe better to say Chomsky's view that developing empirical models is not scientifically interesting), I found this really enriched my understanding of Chomsky's view and gave me a lot of subtlety. He certainly doesn't seem antagonistic towards statistic modeling the way I imagined; just sort of bored by it. Be sure to persist to the end - there are some fun word games on the final page.

Re: Noam Chomsky on Where Artificial Intelligence Went Wrong

#180
Norvig still wins, IMO. Statistics may not explain everything, but it does an amazing job of separating the explainable from the unexplainable. I still see this as the requisite Minimum Viable Product for Artificial Intelligence. If we sat around waiting to perfectly understand neurocognitive linguistic processes before we tried to replicate it, we wouldn't have a functioning Google Translate for another 200 years.
Post reply on HN