Live data from Hacker News

Neural networks in JavaScript – free 19-part course

scrimba.com

71–74 of 74 posts

Re: Neural networks in JavaScript – free 19-part course

#71
post #68
post #39

Earlier quoted context omitted.

afaik it's mostly for cool demos and educational purposes, or extremely latency intensive applications that funny require large models. for most deep learning models, training on the client is completely unreasonable, as they require weeks of training even on multi thousand $ pro equipement. For training, tiny metalearning models are the only reasonable thing to train on the clients in most useful scenarios, as they…

Keep in mind that while the tutorial is in javascript, in the web browser, the neural network easily apply for node based solutions as well. We're adding GPU support that use either client side OR server side GPU, so that any case you mention can be handled.

yes, but afaik node with webgl is strictly slower than cuda/cudnn with Python or whatever serving

Re: Neural networks in JavaScript – free 19-part course

#72
post #68
post #39

Earlier quoted context omitted.

afaik it's mostly for cool demos and educational purposes, or extremely latency intensive applications that funny require large models. for most deep learning models, training on the client is completely unreasonable, as they require weeks of training even on multi thousand $ pro equipement. For training, tiny metalearning models are the only reasonable thing to train on the clients in most useful scenarios, as they…

Keep in mind that while the tutorial is in javascript, in the web browser, the neural network easily apply for node based solutions as well. We're adding GPU support that use either client side OR server side GPU, so that any case you mention can be handled.

unless you also support cuda/cudnn directly now ofc

Re: Neural networks in JavaScript – free 19-part course

#73
post #64

I just watched the reinforcement learning video and was very confused -- where did the reinforcement learning happen? I thought reinforcement learning was giving an agent positive / negative signals to learn without example output data, but in the video the network was just retrained with more data? Is it an overloaded term maybe?

Ty for asking this question! "Reinforcement learning" has a wide definition, but in this case because we are using a simple feed forward neural network, "reinforce" is more principled by dynamic programming with supervised learning. We are not actually using a "Deep reinforcement learning" algorithm. The idea here is that the net can continue to train, reinforcing its previous understanding with new understandings, i…

Thanks for the clarification!

Re: Neural networks in JavaScript – free 19-part course

#74
post #66

Earlier quoted context omitted.

Hey Axel! Just started watching but the interactive guide is incredible. It's like having Screenhero with a private tutor. Only thing is, I kind of wish there were something like the time-coded comments SoundCloud has. At the end of the second guide, we're asked to play around with the tests. I added: console.log(net.run([0, 4])); console.log(net.run([3, 3])); console.log(net.run([8, 4])); Based on the training data,…

Ty! This means a lot! Can you point me to the tutorial you added new tests with?

Hey sorry for the delay, it was at the end of the second tutorial "Our First Neural Net!" I think you were instructing us to try testing the outputs for the other sets in the training data which all work as expected, but I took the "play around with the outputs" instruction to mean, see how the NN responds to novel inputs like the ones I mentioned.
Post reply on HN