[deleted]
Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
41–50 of 159 posts
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#42I think Schmidhuber should be up there. LSTMs are everywhere, not just NLP. The latest Starcraft 2 bot from Deepmind uses LSTMs extensively in its architecture.
Schmidhuber didn't invent LSTM Just by himself. Original papaer was published by Sepp Hochreiter and Schmidhuber.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#43Extremely pleased to see the weird feud with Schmidhuber sparking up again, completely pointless feuds like that are very entertaining, especially since all involved figures have done good work and don't seem to be sabotaging each other's students. It's like pro wrestling for nerds.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#44Earlier quoted context omitted.
No invention occurs in a vacuum, most creations are recombinant effects.The pieces of the puzzle might very well have existed, but Hinton deservedly receives credit for putting the various pieces together for backprop IMHO.
Various researchers, e.g. Werbos, Linnainmaa, Bryson and Yu-Chi Ho have been doing backprop in neural networks before Hinton et al. Hinton was merely a popularizer of the idea.
Wright brothers were most likely not the first to achieve heavier-than-air powered flight. But they made the first controlled, sustained flight. Controlled flight was the real breakthrough in aviation.
It's the same with Hinton et. all. They were among many other pioneers, but what really sets them apart is that they made it all work. They also analyzed why it works.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#45Earlier quoted context omitted.
They don't deserve science award because they didn't do science or pioneer anything. They just responded to demand. They have been awarded with money. It was the high performance scientific computing community that started to use graphics cards to perform matrix computations in the early 2000's. The term GPGPU term was invented. GPU programming pain in the ass in early 2000's. Nvidia saw some markets in GPGPU's for s…
> They don't deserve science award because they didn't do science or pioneer anything. NVidia didn't do science? It depends on what you call science (math and computer science are not "science" according to a very strict definition involving falsifiability). But in any case, an enormous amount of research went into the development of GPUs. It's not just engineering work. Lots of PhD (students) contributed.
the context is DL.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#46Extremely pleased to see the weird feud with Schmidhuber sparking up again, completely pointless feuds like that are very entertaining, especially since all involved figures have done good work and don't seem to be sabotaging each other's students. It's like pro wrestling for nerds.
[deleted]
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#47Earlier quoted context omitted.
> They don't deserve science award because they didn't do science or pioneer anything. NVidia didn't do science? It depends on what you call science (math and computer science are not "science" according to a very strict definition involving falsifiability). But in any case, an enormous amount of research went into the development of GPUs. It's not just engineering work. Lots of PhD (students) contributed.
the context is DL.
True, but neural networks existed for a long time. The hardware is what made NNs actually practical. Recent theoretical advances have been only incremental. For example, CNNs are just evolutionary since image recognition has used convolutions long before NNs were practical, and CNNs are just a straightforward translation of existing techniques to NNs.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#48Earlier quoted context omitted.
Schmidhuber's significance in the field is not at the same level. He invented one type of neural network, but the "Canadian mafia" launched the whole Deep Learning revolution with multiple breakthroughs and theoretical understanding. LSTM's are clever and they were bleeding edge up to 2014, but once they were understood better as a bypass mechanism, attention, context vectors and averaging networks and causal convolu…
Schmidhuber did way more than LSTMs. And they still are SOTA on many tasks. You clearly are not very familiar with the field.
That third sentence is not necessary.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#49I think Schmidhuber should be up there. LSTMs are everywhere, not just NLP. The latest Starcraft 2 bot from Deepmind uses LSTMs extensively in its architecture.
Yes seems political to snub him, but then ACM is an American association.
Dr. LeCun is a French native, for what it's worth
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#50I think Schmidhuber should be up there. LSTMs are everywhere, not just NLP. The latest Starcraft 2 bot from Deepmind uses LSTMs extensively in its architecture.
Schmidhuber's significance in the field is not at the same level. He invented one type of neural network, but the "Canadian mafia" launched the whole Deep Learning revolution with multiple breakthroughs and theoretical understanding. LSTM's are clever and they were bleeding edge up to 2014, but once they were understood better as a bypass mechanism, attention, context vectors and averaging networks and causal convolu…
Ironically Schmidhuber's lab also came up with a more general version of bypassing http://arxiv.org/abs/1505.00387 to train deep networks (with similar performance), of which the popular ResNet is a special case.