Is a 50/50 training:test a normal default ratio for an ANN? I expected to see a higher amount of training data represented as the initial setting.
Tinker with a Neural Network in Your Browser
51–60 of 122 posts
Re: Tinker with a Neural Network in Your Browser
#52In case you are an idiot like me, you have to train your neural network by pressing "play".
We would've liked to have it constantly training, but didn't want to abuse your CPU :)
Re: Tinker with a Neural Network in Your Browser
#53Earlier quoted context omitted.
As far as the recent deep learning boom is concerned, genetic programming is really out of favor. I don't really see it in any of the deep learning (or even machine learning, for that matter) literature/successes/research groups. "Neural networks" are a really really overloaded term. A ton of stuff referred to as "neural networks" has little to do with the "neural networks" that are used in the machine learning commu…
Just curious then, how are people optimizing network topology?
GSD, also known in the literature as "Graduate Student Descent."
I'm not even joking. Trial and error. Having good "intuition" about past ideas the basic building blocks to guide that trial and error. Reading research papers and seeing what other people did well with and using that.
As an aside, this is the principal reason I am skeptical of grandiose claims about deep learning.
Re: Tinker with a Neural Network in Your Browser
#54Earlier quoted context omitted.
As far as the recent deep learning boom is concerned, genetic programming is really out of favor. I don't really see it in any of the deep learning (or even machine learning, for that matter) literature/successes/research groups. "Neural networks" are a really really overloaded term. A ton of stuff referred to as "neural networks" has little to do with the "neural networks" that are used in the machine learning commu…
It has its niche applications. The only non machine vision application that comes to mind is one[1] that takes a pile of data, and evolves a model that fits it. Generally were its actually being used they are a bit quiet on how they go about getting the results they do. While the genetic bit is easy, the secret sauce is in guiding learning/evolution that work for the particular problem domain. [1]: http://www.nutonia…
Yes, but all of the algorithmic advances in academia, and most of the advances at Google/Facebook, have been out in the open.
Re: Tinker with a Neural Network in Your Browser
#55When it says "right here in your browser," it's not joking. On my desktop (Safari), the window becomes unresponsive after a few iterations. Does not happen in Chrome. On my phone (Safari/iOS 9.3), the default neural nework doesn't converge at all even after 300 iterations while it does on the desktop, which is legit weird: https://i.imgur.com/KNaXeHH.png
I'm sorry you're having problems with Safari. I can't reproduce on my end, but if you're still having problems you can raise an issue on github with some information about your system.
Re: Tinker with a Neural Network in Your Browser
#56This is great, but I think they should make it clear that this isn't using TensorFlow.
From the title and domain I though they either had ported TF to Javascript(!) or we connecting to a server.
Re: Tinker with a Neural Network in Your Browser
#57Earlier quoted context omitted.
Hopefully this helps (correct me if I'm wrong, I'm still learning about neural nets): Think of the whole neural net as a function: input * weight = output At each iteration, we feed in the input to the neural net. Then the neural net compares what output it gets to the correct output. For example, input1 is 5, and the correct output for input1 should have been 2. But the neural net got 3 as the output. So it then dec…
Okay, so it works by minimizing (equiv. maximizing) some function. But that doesn't say much about how it "learns" the gradient. What function does it care about? Average squared error (predict_prob-Z_i)^2 ? Average absolute error? The likelihood function of some assumed distribution? Maximum distance between the classification border and closest observed points? If I saw someone carrying a bag full of blueberries an…
The function it minimizes is called the "loss function", and its value for the training and test sets are shown in the upper right area. AFAICT the site doesn't say how it's computed, but I think it's average squared error. The gradient is not learned; if you think of the loss function as a real-valued function of the weights, the gradient is just the partial derivatives with respect to the weights.
Re: Tinker with a Neural Network in Your Browser
#58Re: Tinker with a Neural Network in Your Browser
#59One of the finest data visualization I've seen.
Re: Tinker with a Neural Network in Your Browser
#60This demonstration goes really well with Michael Nielsen's http://neuralnetworksanddeeplearning.com/ . At the bottom of the page the author gives a shout out to Nielsen, Bengio, and others. For someone (like me) who's done a bit of reading but not much implementation, this playground is fantastic!
Really awesome article!