Deep Learning 101

cocoflunchy wrote: post #3

OT but the text selection behavior on this page is fascinating! (Or horrific if you don't want to be nice). I've never seen anything like it. https://www.dropbox.com/s/4k72g8b2tl3mgzt/Screenshot%202013-...

Ahh what are you viewing it on?

Re: Deep Learning 101

#5

Post by cocoflunchy » Thu, Nov 14, 2013, 1:35 AM UTC

mbeissinger wrote: post #4

cocoflunchy wrote: post #3

OT but the text selection behavior on this page is fascinating! (Or horrific if you don't want to be nice). I've never seen anything like it. https://www.dropbox.com/s/4k72g8b2tl3mgzt/Screenshot%202013-...

Ahh what are you viewing it on?

Chrome 31.0.1650.48 on OSX

Re: Deep Learning 101

#6

Post by mbeissinger » Thu, Nov 14, 2013, 1:36 AM UTC

arjunrajjain wrote: post #2

This is awesome!

Thanks!

Re: Deep Learning 101

#7

Post by sudont » Thu, Nov 14, 2013, 1:41 AM UTC

cocoflunchy wrote: post #5

mbeissinger wrote: post #4

Earlier quoted context omitted.

Ahh what are you viewing it on?

Chrome 31.0.1650.48 on OSX

31.0.1650.48 here as well.

It appears to be a bug with a combination of the ::selected pseudoelement in conjunction with the font Georgia. My guess is it's a Chrome-on-mac bug (Firefox is fine), not a site coding error.

Disabling either the font or the selection style fixes it. Most likely a text rendering issue. At work we've noticed Chrome getting buggier in relation to that, as well as retaining DOM node properties via redraws.

Re: Deep Learning 101

#8

Post by mbeissinger » Thu, Nov 14, 2013, 1:42 AM UTC

cocoflunchy wrote: post #5

mbeissinger wrote: post #4

Earlier quoted context omitted.

Ahh what are you viewing it on?

Chrome 31.0.1650.48 on OSX

Odd. I can't replicate on any browser but I don't have OSX. Does it work fine on your other browsers?

Re: Deep Learning 101

#9

Post by Noxchi » Thu, Nov 14, 2013, 1:52 AM UTC

What does it take to be good at machine learning such as this? In terms of mathematics, and computer science knowledge?

I know how to code through self learning, and I've pretty much solely done web development. So I barely know much CS. Also not very good at math.

So what are the essential prerequisites you would say are necessary for doing neat, useful stuff with machine learning?

Re: Deep Learning 101

#10

Post by brandonb » Thu, Nov 14, 2013, 1:54 AM UTC

This is a cool tutorial!

It's ironic that deep neural networks have become the biggest machine learning breakthrough of 2013: they were also the biggest machine learning breakthrough of 1957. The idea dates back to the Perceptron, one of the oldest ideas in AI.

One thing to note: although there was a lot of initial excitement about Restricted Boltzman Machines, Auto-encoders, and other unsupervised approaches, the best results in the last year or so have all used conventional the back-propagation algorithm from 1974, with a few tweaks. http://en.wikipedia.org/wiki/Backpropagation

Ben Lorica wrote a good article on the latest deep learning research from Google, and what's changed since neural networks were last popular in the 1980's: http://strata.oreilly.com/2013/10/deep-learning-oral-traditi...

What's old is new again.