Congrats! Absolutely well deserved. Simons' Foundations of Deep Learning seminar this Summer 2019 will seek to illumine some of the issues around reproducibility, failure modes, etc
Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
21–30 of 159 posts
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#22I think NVidia deserves part of the award, as they have been a major factor in the progress of NNs.
Is this a meme? No they have not. Sure they are a popular hardware provider, but NN have been around before they were even a company. I think Fukushima deserves a spot here too, before giving it to Nvidia, but there are so many people that have contributed to NN, so I guess those in the spotlight take the glory if it must be taken.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#23I think NVidia deserves part of the award, as they have been a major factor in the progress of NNs.
For making insanely painful-to-deal with dependencies and effectively instituting de facto vendor lock-in for deep learning?
Nah.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#24I think NVidia deserves part of the award, as they have been a major factor in the progress of NNs.
Could you be more specific? I was inclined to respond, "Intel, too. And keyboard and monitor manufacturers. And throw in John Von Neumann!"
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#25I think NVidia deserves part of the award, as they have been a major factor in the progress of NNs.
Could you be more specific? I was inclined to respond, "Intel, too. And keyboard and monitor manufacturers. And throw in John Von Neumann!"
Von Neumann thought about artificial neural networks too: https://ia800800.us.archive.org/4/items/TheComputerAndTheBra...
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#26For a more balanced view of the history of deep learning see Schmidhuber‘s review http://people.idsia.ch/~juergen/deep-learning-overview.html and http://people.idsia.ch/~juergen/who-invented-backpropagation... .
No invention occurs in a vacuum, most creations are recombinant effects.The pieces of the puzzle might very well have existed, but Hinton deservedly receives credit for putting the various pieces together for backprop IMHO.
[deleted]
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#27Download and install your Norton product https://nortonsetup-key.com. Sign In to Norton. If you do not have a Norton account, click Create account and complete the sign up process. In the Norton Setup window, click Enter a New Product Key. To enroll in Automatic Renewal Service for your Norton subscription, Get Started
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#28I have a browser extension that replaces the phrase "Artificial Intelligence" with the phrase "A bunch of if statements". This might have been one of the top results.
I'm also quite dismissive of AI overuse. My preferred substitution is s/Machine Learning/Machine Guessing. However, these are 3 people who overcame a lot of nay-sayers to prove some something could actually work. I remember back in university the lecturer said that neural networks couldn't scale because of the vanishing gradient problem. It was actually very easy to be critical, you want fit a massive number of param…
Computational Statistics is probably most accurate.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#29I think Schmidhuber should be up there. LSTMs are everywhere, not just NLP. The latest Starcraft 2 bot from Deepmind uses LSTMs extensively in its architecture.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#30Geoffrey Hinton's tech-talk in 2007 (!) at Google is a great watch (with a heavy dose of technical jargon [0] plus some dry British humour interlaced throughout). He explains digit recognition (vs SVM) [1], document classification (vs LSH), and breifly summarises image classification [2] problems and how they were solved: https://youtu.be/AyzOUbkUf3M You could instantly see the results he presents were way better tha…
Although 3b1b's videos are awesome, his NN videos are heavily inspired by this: http://neuralnetworksanddeeplearning.com/. Even the code on his github page is taken from there.