Fridman's podcast has to be among the highest concentrations of high-calibre guests ever assembled in this area. Week after week it's another huge name.
Lex here. Thank you. I realize I sometimes miss opportunities for depth or insight with these brilliant folks, but I work hard to improve. The comments on this post, positive and critical, help. So again, thank you.
Thinking Fast and Slow, Deep Learning, and AI [video]
101–104 of 104 posts
Re: Thinking Fast and Slow, Deep Learning, and AI [video]
#102Earlier quoted context omitted.
While I definitely understand where you are coming from, I think Lex's style can grow on you. My advice would be to ask shorter questions, sometimes Lex you try to explain what you mean. I would just drop the question and let the other person start talking instead of you trying to fill the silence. Also I do really enjoy the questions about meaning of life (maybe more discussions on free will would be great too). In…
Lex here. The amount of positive and thoughtful comments here is humbling. From the bottom of my heart, thank you. Here are things I didn't realize is the role of the interviewer (my role) but I now know they are: 1. Push towards depth, because not all people go there naturally themselves. 2. Ask for clarifications if I don't understand something. This can make me sound stupid, but it's a worthy sacrifice. I will alw…
Re: Thinking Fast and Slow, Deep Learning, and AI [video]
#103Re: Thinking Fast and Slow, Deep Learning, and AI [video]
#104Earlier quoted context omitted.
I got your answer! He indeed explicitely says in the interview that deep learning is really system 1 only. That was surprising but makes total sense — it's an unconscious, automatic, fast, effort-free response, which is exactly what system 1 is. Note that both system 1 and 2 are trainable and able to perform complex tasks (he takes the example of a chess player for whom only strong moves come to mind, which is system…
Would you consider using neural nets to solve integration and differential equations as it doing system 2 reasoning? https://ai.facebook.com/blog/using-neural-networks-to-solve-... Or what tasks are in the domain of system 2?
I believe it's totally "system 1", and actually by design.
First of all it's not a new kind of NN, it's more about applying a given problem to another technique, name consider math syntax as just another kind of language:
> represent complex mathematical expressions as a kind of language and then treating solutions as a translation problem
(which might seem obvious but I guess it took that much refinement to yield actual results)
Now, take these quotes, emphasis mine:
> Humans who are particularly good at symbolic math often rely on a kind of intuition. They have a sense of what the solution to a given problem should look like
> By training a model to detect patterns in symbolic equations, we believed that a neural network could piece together the clues that led to their solutions, roughly similar to a human’s intuition-based approach to complex problems.
Intuition, intuition-based approach: this is exactly what system 1 represents.
Also note the results:
> Our model demonstrated 99.7 percent accuracy when solving integration problems, and 94 percent and 81.2 percent accuracy, respectively, for first- and second-order differential equations.
One major difference between systems 1 and 2 is that 1 is fuzzy, intuitive, it's not always exact, it's very analog; whereas system 2 is able to be correct, exact, precise — and like the researchers themselves validating the 5,000 answers, you'd expect a "well trained" math intelligence to solve 100% (or close enough) of these problems. It may take time but give yourself 20 years and you'll get there no doubt; whereas this narrow language-AI with one hundred million examples still makes mistakes.
Very system 1 indeed.