Live data from Hacker News

How deep learning on GPUs wins datamining contest without feature engineering

blog.kaggle.com

11–15 of 15 posts

Re: How deep learning on GPUs wins datamining contest without feature engineering

#11
post #5
post #2

The author points out something about these Machine Learning contests and Machine Learning in general that I've noticed for a while - feature selection tends to dominate learning algorithm selection. It's good to see that there are modern academic methods for feature discovery that seem to be on par with (or better than) a domain expert manually selecting features.

Yes, but just as with normal feature engineering, don't make the mistake of thinking that these methods are fully automatic work by magic. There is no free lunch. A common criticism with these methods is that they merely shift engineering from features to parameters that specify the architecture. There are many choices to be made: The exact number of layers, number of neurons per layer, the connectivity, sparsity par…

The problem with using intuition for feature engineering is that intuition is often wrong. But more than that, it's much less scalable than a system that learns progressively higher level features from lower level data automatically.

And parameter selection isn't nearly as involved in practice--but it is important to know what you're doing because you'll basically be translating from papers to code in order to get a working implementation, at least until some startup comes out with a plug and play deep learning paas

For anyone interested in playing with the tools that are available, deeplearning.net provides a set of very good tutorials with working code.

Re: How deep learning on GPUs wins datamining contest without feature engineering

#12
post #9
post #4

Given that pharma is a massive industry and that drug discovery often costs around 1 billion dollars, the top prize of $22,000 seems awfully low. Will we start to see larger prizes, or will startups take this technology and monetize better than academia currently does?

With Geoffrey Hinton involved as a supervisor I expect they were on the bleeding edge for other reasons anyway and just decided to scoop up some extra cash as well. I've not looked closely but Kaggle does seem to be a little like 99designs though.

The Heritage Health Prize is $ 3 million! No exactly 99designs regime. [1] https://www.heritagehealthprize.com/c/hhp

Re: How deep learning on GPUs wins datamining contest without feature engineering

#13
post #12
post #9

Earlier quoted context omitted.

With Geoffrey Hinton involved as a supervisor I expect they were on the bleeding edge for other reasons anyway and just decided to scoop up some extra cash as well. I've not looked closely but Kaggle does seem to be a little like 99designs though.

The Heritage Health Prize is $ 3 million! No exactly 99designs regime. [1] https://www.heritagehealthprize.com/c/hhp

The heritage prize is $3 million dollars if a certain threshold score is met.

I'm on the team currently in 1st place, and I don't think there is any chance that any team will meet this threshold.

So, the final prize will be $500,000. Still, not 99designs.

Re: How deep learning on GPUs wins datamining contest without feature engineering

#14
post #4

Given that pharma is a massive industry and that drug discovery often costs around 1 billion dollars, the top prize of $22,000 seems awfully low. Will we start to see larger prizes, or will startups take this technology and monetize better than academia currently does?

There is no shortage of people interested in machine learning.

Re: How deep learning on GPUs wins datamining contest without feature engineering

#15
post #13
post #12

Earlier quoted context omitted.

The Heritage Health Prize is $ 3 million! No exactly 99designs regime. [1] https://www.heritagehealthprize.com/c/hhp

The heritage prize is $3 million dollars if a certain threshold score is met. I'm on the team currently in 1st place, and I don't think there is any chance that any team will meet this threshold. So, the final prize will be $500,000. Still, not 99designs.

Interesting. Thanks for the clarification!
Post reply on HN