Do you think (HN) that this incentive boost will mean more people who're working on fringe risky ideas will get the energy and persistence to keep going? Will we see a bump in 10 or so years of innovations coming from people who would have otherwise given up (had this award not been given)? Hard to measure of course, but what's your hunch?
Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
71–80 of 159 posts
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#72Earlier quoted context omitted.
Then you must be sad when the Internet was invented as well ? How about cars ?
I didn't realize the internet or cars were created by the employees of advertising corporations for the sole purpose of furthering their surveillance and user manipulation capabilities. Also, my comment was about people being given awards, not people inventing things.
None of these people do that though, they all work on theoretical research.
Do you hold the same opinion of the people at Bell labs who got Turing or Nobel awards?
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#73It saddens me to see these people being given awards for improving the surveillance and manipulation capabilities of advertising corporations. This isn't how you encourage people to use their abilities to contribute to society in a positive way.
It saddened me when Boyle and Smith won the Nobel prize in Physics for inventing CCD which powers digital cameras and is of no use other than surveillance by big brother. Don't get me started about Alexander Graham Bell /s
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#74Earlier quoted context omitted.
Schmidhuber's significance in the field is not at the same level. He invented one type of neural network, but the "Canadian mafia" launched the whole Deep Learning revolution with multiple breakthroughs and theoretical understanding. LSTM's are clever and they were bleeding edge up to 2014, but once they were understood better as a bypass mechanism, attention, context vectors and averaging networks and causal convolu…
Schmidhuber did way more than LSTMs. And they still are SOTA on many tasks. You clearly are not very familiar with the field.
Whoa. Personal attacks will get you banned here. We've warned you about this more than once before. Please review https://news.ycombinator.com/newsguidelines.html and follow the rules when posting here. When you do, don't miss this one, since it should have changed your assumption about the GP:
"Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith."
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#75Earlier quoted context omitted.
Ironically Schmidhuber's lab also came up with a more general version of bypassing http://arxiv.org/abs/1505.00387 to train deep networks (with similar performance), of which the popular ResNet is a special case.
But highway network doesn't work as well as ResNet, and ResNet is simpler.
Highway connections are actually used heavily in NLP in combination with LSTMs.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#76I think NVidia deserves part of the award, as they have been a major factor in the progress of NNs.
Is this a meme? No they have not. Sure they are a popular hardware provider, but NN have been around before they were even a company. I think Fukushima deserves a spot here too, before giving it to Nvidia, but there are so many people that have contributed to NN, so I guess those in the spotlight take the glory if it must be taken.
...Fukushima? Is it a typo for someone (or some company)?
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#77Earlier quoted context omitted.
Ironically Schmidhuber's lab also came up with a more general version of bypassing http://arxiv.org/abs/1505.00387 to train deep networks (with similar performance), of which the popular ResNet is a special case.
But highway network doesn't work as well as ResNet, and ResNet is simpler.
Highway networks with scalar gating beats ResNet by a small margin.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#78Tbqh schmidhuber absolutely deserves a spot here. Not just for LSTMs, but also predictability minimization, various interesting intrinsic motivation concepts etc.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#79Wake sleep algorithm baby! Long live the Helmholtze machine!
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#80Earlier quoted context omitted.
the context is DL.
True, but neural networks existed for a long time. The hardware is what made NNs actually practical. Recent theoretical advances have been only incremental. For example, CNNs are just evolutionary since image recognition has used convolutions long before NNs were practical, and CNNs are just a straightforward translation of existing techniques to NNs.
Sure theoretical advances may be evolutionary, but they resulted in exponential reduction of parameter space and sample complexity. These advances outpace Moore's law by a large margin.
Hardware served as a catalyst, but it was not a necessity.