“Deep Learning has outlived its usefulness as a buzz-phrase”

Post by cs702 » Sat, Jan 06, 2018, 4:09 AM UTC

seanmcdirmid wrote: post #58

cs702 wrote: post #49

I wish we could come up with a catchier name, but I LOVE the idea of calling this programming , because that is precisely what we do when we compose deep neural nets. For example, here's how you compose a neural net consisting of two "dense" layers (linear transformations), using Keras's functional API, and then apply these two layers to some tensor x to obtain a tensor y: f = Dense(n) g = Dense(n) y = f(g(x)) This l…

LeCun specifically calls out imperative programming, not just typical data flow methods.

Post by maxtollenar » Sat, Jan 06, 2018, 4:22 AM UTC

bra-ket wrote: post #35

rememberlenny wrote: post #3

[Text from post] OK, Deep Learning has outlived its usefulness as a buzz-phrase. Deep Learning est mort. Vive Differentiable Programming! Yeah, Differentiable Programming is little more than a rebranding of the modern collection Deep Learning techniques, the same way Deep Learning was a rebranding of the modern incarnations of neural nets with more than two layers. But the important point is that people are now build…

it's really a pity that after 75 years of AI research the best thing we've got is still based on gradient descent, a brute force trial and error.

Post by mturmon » Sat, Jan 06, 2018, 4:39 AM UTC

bra-ket wrote: post #35

rememberlenny wrote: post #3

[Text from post] OK, Deep Learning has outlived its usefulness as a buzz-phrase. Deep Learning est mort. Vive Differentiable Programming! Yeah, Differentiable Programming is little more than a rebranding of the modern collection Deep Learning techniques, the same way Deep Learning was a rebranding of the modern incarnations of neural nets with more than two layers. But the important point is that people are now build…

it's really a pity that after 75 years of AI research the best thing we've got is still based on gradient descent, a brute force trial and error.

Post by qwerty456127 » Sat, Jan 06, 2018, 4:45 AM UTC

danbmil99 wrote: post #6

"See more of Yann LeCun on Facebook" popup, no access to the page. No, I don't want to create a Facebook account to read a blog post. Perhaps links to walled-garden pages where you need an account and need to be logged in should be prohibited or at least discouraged.

Post by zeth__ » Sat, Jan 06, 2018, 5:18 AM UTC

log_base_login wrote: post #40

bra-ket wrote: post #35

Earlier quoted context omitted.

it's really a pity that after 75 years of AI research the best thing we've got is still based on gradient descent, a brute force trial and error.

As much of a pity that, 70 years later, we are still using transistor based computers originally derived from three wires stuck in a piece of rock[1] by some very innovative fellows at Bell Labs[2]? [1] http://images.computerhistory.org/revonline/images/500004836... [2] http://www.computerhistory.org/revolution/digital-logic/12/2...