Earlier quoted context omitted.
>> My case against hardcoding some kind of symbolic logic within the architecture of an AI model is that there won't be a way to challenge the symbols as the brain does. Who said anything about hardcoding anything? Marcus is advocating for the use of gradient descent to learn symbols- he even cites the DeepMind paper on θILP, a differentiable Inductive Logic Programming system that learns symbolic rules with deep lea…
From the article > Their solution? A hybrid model that vastly outperformed what a purely deep net would have done, incorporating both back-propagation and (continuous versions) of the primitives of symbol manipulation, including both explicit variables and operations over variables This is what I called "hardcoding some kind of symbolic logic". Is it not?
Why Robot Brains Need Symbols
71–73 of 73 posts
Re: Why Robot Brains Need Symbols
#72Earlier quoted context omitted.
>> My case against hardcoding some kind of symbolic logic within the architecture of an AI model is that there won't be a way to challenge the symbols as the brain does. Who said anything about hardcoding anything? Marcus is advocating for the use of gradient descent to learn symbols- he even cites the DeepMind paper on θILP, a differentiable Inductive Logic Programming system that learns symbolic rules with deep lea…
From the article > Their solution? A hybrid model that vastly outperformed what a purely deep net would have done, incorporating both back-propagation and (continuous versions) of the primitives of symbol manipulation, including both explicit variables and operations over variables This is what I called "hardcoding some kind of symbolic logic". Is it not?
Re: Why Robot Brains Need Symbols
#73AI development has hit a plateau in terms of performance and funding saturation. All investment is now expected to deliver some semblance of market performance before the great Margin Call of 2019 hits, which means scaling out AI to absurd domains and deploying vast armies of surplus humans to either code or emulate profitable-enough behavior to pass the risk on to the next investor round. In the end, the Mechanical…
What is the evidence for a plateau? The corporate temperaments are irrelevant to the actual progress of the field. If anything , ai systems have not even started being deployed , and the field is even missing a proper theoretical framework. this should indicate that it's still very early stage
https://en.wikipedia.org/wiki/AI_winter
The plateau comes from the problems with vanishing gradients.