Live data from Hacker News

Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

nytimes.com

11–20 of 98 posts

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#11

Maybe good AI requires a combination of symbolic approaches for the knowledge representation, deep parsing for NLP and semantics/discourse models, and machine learning for pattern recognition tasks of any kind. The currently trendy "AI" looks more like massive data mining with powerful ML to me, that's very good for certain tasks but brings us nowhere near real AI. The knowledge representation problem has not yet bee…

>> Generally speaking, logical modelling is too limited for good concept representations

In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. The problem is that in practice it is very hard to transfer into a logic language all the knowledge you might need for a useful system.

In fact, this was one motivation for at least one branch of machine learning- the work from Ryszard Michalski, Claude Sammut, Ranan Banerji, Steven Vere, Brian Cohen and later rule-learners like Quinlan's decision tree learners and of course all the later work in Inductive Logic Programming by Plotkin, Shapiro, Muggleton etc. These are all rule-learning systems, that can avoid the knowledge acquisition bottleneck that probably did in for purely rule-based expert systems in the '90s (i.e. getting experts to transfer their knowledge into rules).

I rather agree that further progress in AI will require a, let's say, synchretistic approach- like I say in another comment, the obvious thing for me is to use deep learning for perception, logic for inference and probabilistic modelling to deal with the noisy world. There are some people working in that sort of direction, with different amounts of emphasis on each of the three approaches. For instance, Josh Tenenbaum at MIT, Evans and Grefenstette at DeepMind, Luc De Raedt at KU Leuven, Kristian Kersting at Dortmund, Lise Getoor also at MIT, Pedro Domingos at Washington, and many others.

Apologies for all the name-dropping without links. Let me know and I can provide them if required.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#12
post #3

Why prolog? Why not PRISM or problog?

This is a valid question, I don't know why you (originally) got downvoted.

The answer I think, for the applications in industry at least, is that PRISM and other probabilistic programming langauges are not as developed as Prolog, a language that has been around for a good four decades now. Swi-Prolog in particular, is a free and open-source Prolog interpreter with an IDE, a graphical package and a veritable somrgasbord of libraries, including an http server, json and xml processing, encryption, interfaces to SQL and other databases etc etc etc. Swi is in active development, compatible with YAP-Prolog (currently the fastest implementation) very well supported and documented and has an active community.

It's a lot easier to setup a production environment in Prolog, especially using Swi, than in pretty much any other logic programming language, including the probabilistic logic programming ones.

Btw, I noticed that Kyndi list experience with Logtalk as a "plus" for one of their career opportunities (of course I looked :) which means that they're probably using Swi-Prolog.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#13

Lets rename "Deep learning" to "Statistical Compression". Its essentially distilled data from a dataset, limited by size of the neural network. There isn't anything "deep" there, the goal of NN is always towards overfitting the data.

There is something deep there - the neural networks are deep. They have lots of layers. It's in contrast to shallow neural networks.

It doesn't mean "deep and meaningful".

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#14

Maybe good AI requires a combination of symbolic approaches for the knowledge representation, deep parsing for NLP and semantics/discourse models, and machine learning for pattern recognition tasks of any kind. The currently trendy "AI" looks more like massive data mining with powerful ML to me, that's very good for certain tasks but brings us nowhere near real AI. The knowledge representation problem has not yet bee…

I think this is the perspective the "Society of the Mind" book by Marvin Minsky took at their time. When a software like Mathematica makes symbolic operations it is doing AI, the same for things like the Z3 solver.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#15

Maybe good AI requires a combination of symbolic approaches for the knowledge representation, deep parsing for NLP and semantics/discourse models, and machine learning for pattern recognition tasks of any kind. The currently trendy "AI" looks more like massive data mining with powerful ML to me, that's very good for certain tasks but brings us nowhere near real AI. The knowledge representation problem has not yet bee…

The geometric approach is promising. I am working on a project that implements it. It is still a work in progress but things are moving along quite nicely. You can read more about IEML at https://pierrelevyblog.com/my-research-in-a-nutshell/the-bas...

The researcher, Prof. Levy, is French :)

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#16

Lets rename "Deep learning" to "Statistical Compression". Its essentially distilled data from a dataset, limited by size of the neural network. There isn't anything "deep" there, the goal of NN is always towards overfitting the data.

Lets rename "Deep learning" to "Statistical Compression"

The previous name for what is now called “machine learning” was predictive statistics. But a better name for deep learning is “machine intuition” since it seems to work pretty well but can’t be readily explained

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#17

Lets rename "Deep learning" to "Statistical Compression". Its essentially distilled data from a dataset, limited by size of the neural network. There isn't anything "deep" there, the goal of NN is always towards overfitting the data.

There is something deep there - the neural networks are deep. They have lots of layers. It's in contrast to shallow neural networks. It doesn't mean "deep and meaningful".

It doesn't mean "deep and meaningful".

It would not be nearly as well funded were it not for this misconception on the part of budget holders, and everyone involved in ML knows it.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#18

Maybe good AI requires a combination of symbolic approaches for the knowledge representation, deep parsing for NLP and semantics/discourse models, and machine learning for pattern recognition tasks of any kind. The currently trendy "AI" looks more like massive data mining with powerful ML to me, that's very good for certain tasks but brings us nowhere near real AI. The knowledge representation problem has not yet bee…

>> Generally speaking, logical modelling is too limited for good concept representations In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. The problem is that in practice it is very hard to transfer into a logic language all the knowledge you might need for a useful system. In fact, this was one motivation for at least one branch of machine le…

I suspect you may have a hard time representing all the implications, subtexts, and allusions in a play by Shakespeare with First Order Logic.

It seems more likely that First Order Logic can be represented by a subset of natural language.

Otherwise, I agree. I don't understand why everyone has been concentrating so hard on probabilistic ML when there are many applications where inductive inference is more efficient and powerful.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#19

Maybe good AI requires a combination of symbolic approaches for the knowledge representation, deep parsing for NLP and semantics/discourse models, and machine learning for pattern recognition tasks of any kind. The currently trendy "AI" looks more like massive data mining with powerful ML to me, that's very good for certain tasks but brings us nowhere near real AI. The knowledge representation problem has not yet bee…

>> Generally speaking, logical modelling is too limited for good concept representations In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language. The problem is that in practice it is very hard to transfer into a logic language all the knowledge you might need for a useful system. In fact, this was one motivation for at least one branch of machine le…

> In principle, First Order Logic and equivalent languages can represent anything that can be represented in natural language.

Is there any proof about an existing non-leaky abstraction between natural language and First Order Logic (or logic in general)? Afaik there is none, but I might me wrong. For example (one amongst thousands): “I don’t like you” can actually mean (and it often does) the exact opposite, and the same can be said of a simple statement like “I am ok” which also can mean the exact opposite. Natural language is a very hard problem.

Re: Is There a Smarter Path to Artificial Intelligence? Some Experts Hope So

#20

Somehow the main article link is behind a paywall for me, but the mobile one is not: https://mobile.nytimes.com/2018/06/20/technology/deep-learni... (YMMV)

The New York Times and Washington Post both use a "fingerprint" method to identify unique users using things like your browser version and IP address. I like using Firefox nightly because a quick update to Nightly will make it appear that I'm a new user and will reset my free "monthly" article limit. That's also why switching browsers will work for some people, but not others.
Post reply on HN