Live data from Hacker News

Why Robot Brains Need Symbols

nautil.us

71–73 of 73 posts

Re: Why Robot Brains Need Symbols

#71
post #68

Earlier quoted context omitted.

>> My case against hardcoding some kind of symbolic logic within the architecture of an AI model is that there won't be a way to challenge the symbols as the brain does. Who said anything about hardcoding anything? Marcus is advocating for the use of gradient descent to learn symbols- he even cites the DeepMind paper on θILP, a differentiable Inductive Logic Programming system that learns symbolic rules with deep lea…

From the article > Their solution? A hybrid model that vastly outperformed what a purely deep net would have done, incorporating both back-propagation and (continuous versions) of the primitives of symbol manipulation, including both explicit variables and operations over variables This is what I called "hardcoding some kind of symbolic logic". Is it not?

[deleted]

Re: Why Robot Brains Need Symbols

#72
post #68

Earlier quoted context omitted.

>> My case against hardcoding some kind of symbolic logic within the architecture of an AI model is that there won't be a way to challenge the symbols as the brain does. Who said anything about hardcoding anything? Marcus is advocating for the use of gradient descent to learn symbols- he even cites the DeepMind paper on θILP, a differentiable Inductive Logic Programming system that learns symbolic rules with deep lea…

From the article > Their solution? A hybrid model that vastly outperformed what a purely deep net would have done, incorporating both back-propagation and (continuous versions) of the primitives of symbol manipulation, including both explicit variables and operations over variables This is what I called "hardcoding some kind of symbolic logic". Is it not?

I don't understand what you mean. Where's the hard-coding?

Re: Why Robot Brains Need Symbols

#73
post #63
post #4

AI development has hit a plateau in terms of performance and funding saturation. All investment is now expected to deliver some semblance of market performance before the great Margin Call of 2019 hits, which means scaling out AI to absurd domains and deploying vast armies of surplus humans to either code or emulate profitable-enough behavior to pass the risk on to the next investor round. In the end, the Mechanical…

What is the evidence for a plateau? The corporate temperaments are irrelevant to the actual progress of the field. If anything , ai systems have not even started being deployed , and the field is even missing a proper theoretical framework. this should indicate that it's still very early stage

There's a long history of cycles in this field.

https://en.wikipedia.org/wiki/AI_winter

The plateau comes from the problems with vanishing gradients.

https://en.wikipedia.org/wiki/Vanishing_gradient_problem

Post reply on HN