Companies should jointly give CIFAR a big fat award too. :-D Without CIFAR's 10 million dollars back in 2003 to the research groups of 15 people, led by Hinton, the research groups may have dissolved due to lack of funding, and our history would be different.
Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
81–90 of 159 posts
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#82Earlier quoted context omitted.
Then you must be sad when the Internet was invented as well ? How about cars ?
I didn't realize the internet or cars were created by the employees of advertising corporations for the sole purpose of furthering their surveillance and user manipulation capabilities. Also, my comment was about people being given awards, not people inventing things.
I didn't realize the internet or cars were created by the employees of advertising corporations for the sole purpose of furthering their surveillance and user manipulation capabilities.
Seriously man? Do you think you might be being just a little bit hyperbolic there? I mean, it's pretty darn clear that Deep Learning isn't "created ... for the sole purpose of furthering ... surveillance and user manipulation capabilities" when almost all of the papers on the topic are freely available on arXiv, and source code for nearly every important implementation is available as Open Source, usually in multiple languages, using multiple different frameworks (which are almost all Open Source as well). I mean, sure, Google use Deep Learning to display ads... great. But you, or me, or anybody else, can also use the same techniques for our own (presumably more noble) ends.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#83It's interesting to me that most comments are confusing Deep Learning with the whole field of AI in general, when it is actually a subset of Machine Learning.
Well deserved anyhow!
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#84Earlier quoted context omitted.
No invention occurs in a vacuum, most creations are recombinant effects.The pieces of the puzzle might very well have existed, but Hinton deservedly receives credit for putting the various pieces together for backprop IMHO.
Various researchers, e.g. Werbos, Linnainmaa, Bryson and Yu-Chi Ho have been doing backprop in neural networks before Hinton et al. Hinton was merely a popularizer of the idea.
"merely"
People deserve credit for taking an idea and running with it. Without Hinton's efforts (in 1987, 2006, or 2012), deep learning would have never seen the explosive growth.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#85This is well deserved, but IMO it also signals an upcoming AI winter. This cycle has happened several times before:
1) Some scrappy researcher on a low budget develops a new AI technology that shows promise in a specific area.
2) More researchers take that idea and successfully apply it more broadly.
3) Massive investment in research happens, pushing PhD candidates into extracting every possible nuance out of that technology.
4) Researchers, encouraged by the broad success, begin to think we've found the one true key in the quest towards general intelligence. Suddenly all the researchers are Neats. The research funding is now mostly businesses instead of governments and non-profits. They grow overconfident that it can be used for virtually anything, funding everything in sight.
5) Starry-eyed futurists start lionizing the founders of the new revolution as geniuses, publishing flowery bullshit about how the world will be forever changed and how the General AI revolution is only 5-10 years away.
6) Surprise! It actually can't be used that broadly. Improvements stall, and CEOs start to realize that they can't just dump data in and get money out. It becomes a commercial disappointment, triggering disinvestment.
7) The Neats, disappointed that their glamorous and simplistic theory of general intelligence, start to disappear. Newspapers begin to make fun of all of the visionaries, comparing them to the people that said flying cars were 5-10 years away.
8) A handful of Scruffies take over the now low-funding AI winter, working hard on minimal budgets until a new breakthrough is found and we return back to #1.
This article is showing that we're solidly within stage 5, and we're already seeing signs of stage 6. When everybody is buying, it's time to sell.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#86Earlier quoted context omitted.
Is this a meme? No they have not. Sure they are a popular hardware provider, but NN have been around before they were even a company. I think Fukushima deserves a spot here too, before giving it to Nvidia, but there are so many people that have contributed to NN, so I guess those in the spotlight take the glory if it must be taken.
...Fukushima? Is it a typo for someone (or some company)?
He's credited with first introducing the CNN architecture (Neocognitron) and a way to train it with unsupervised learning, inspired by the neurological research of Hubel and Wiesel and his earlier work in training neural networks with unsupervised learning (backprop is now used instead). Probably one of the most famous neural network papers. https://www.rctn.org/bruno/public/papers/Fukushima1980.pdf
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#87This is well deserved, but IMO it also signals an upcoming AI winter. This cycle has happened several times before: 1) Some scrappy researcher on a low budget develops a new AI technology that shows promise in a specific area. 2) More researchers take that idea and successfully apply it more broadly. 3) Massive investment in research happens, pushing PhD candidates into extracting every possible nuance out of that te…
There's good reason to think that the AI Winter / AI Spring cycle is done. AI techniques are now creating so much real world value (more so than in the 80's / 90's) that there may well not be any more "AI Winter" events. Or perhaps they will be, but they'll be less pronounced. Maybe an "AI Fall" instead of "AI Winter".
Part of that too, is that I think people now realize that narrow AI is sufficient to create tremendous value, and that it doesn't necessarily matter if the "AGI breakthrough" happens anytime soon or not.
It's hard to be sure, but I don't see the kind of collapse that happened in the past happening anytime soon.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#88Earlier quoted context omitted.
Schmidhuber did way more than LSTMs. And they still are SOTA on many tasks. You clearly are not very familiar with the field.
I'm not saying that Schmidhuber is not important pioneer in the field. When you put researchers or groups into order of importance, the work from this trio comes before others, including Schmidhuber. The Turing Award is given to those at the top and it's not inclusive. If I could give Turing Award for someone in the field who has not received it yet, I would give it to Vladimir Vapnik.
Sorry.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#89Earlier quoted context omitted.
Schmidhuber did way more than LSTMs. And they still are SOTA on many tasks. You clearly are not very familiar with the field.
Whoa. Personal attacks will get you banned here. We've warned you about this more than once before. Please review https://news.ycombinator.com/newsguidelines.html and follow the rules when posting here. When you do, don't miss this one, since it should have changed your assumption about the GP: " Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize…
You're right. Sorry.
Re: Yann LeCun, Geoffrey Hinton and Yoshua Bengio win Turing Award
#90I would love to hear a long form podcast with all three (and a CS knowledgeable interviewer)
There's a Youtube channel called something like 'AI Channel' that has relevant talks. LeCun did a big one a few months ago. Hinton has had at least one Google Talk.