So this is pretty interesting. One of the great hopes of the current deep learning boom is that somehow we will develop unsupervised or at least semi-supervised techniques which can perform close to the great results that are being seen with supervised learning. Adversarial Networks is one of the more likely routes to semi-supervised. There is also a lot of interesting work in combining Bayesian optimization techniqu…
> the one-shot learning paper coming out of (I've forgotten!!) where the authors are famously doubtful about the utility of Deep Learning This? https://www.technologyreview.com/s/544376/this-ai-algorithm-... http://cims.nyu.edu/~brenden/LakeEtAl2015Science.pdf
That was it, although I see I've conflated the views of Gary Marcus (who I think it is fair to characterize as anti-Deep Learning[1]) and Lake, Salakhutdinov, and Tenenbaum who wrote the paper.
[1] https://www.technologyreview.com/s/544606/can-this-man-make-...