Viewing profile — charleshmartin

If you train a model for too long, it may overfit it's training data. Not surprising, this has been know for like forever. But did you know you can detect the signatures of overfit…

Right. If the dynamics of training are governed by RG flow, then the best optimization path should remove redundant directions, as specified by the RG operator(s)

We present a SemiEmpirical Theory of Learning (SETOL) that explains the remarkable performance of State-Of-The-Art (SOTA) Neural Networks (NNs). We provide a formal explanation of …

SETOL is a theory of NN layer convergence. It argues that the individual layers of NN converge at different rates, and the 'Ideal' state of convergence can be detected simply by lo…

There are good theoretical reasons behind this as well https://calculatedcontent.com/2023/02/01/deep-learning-and-e...

Envy

ENVY

WeightWatcher (w|w) is an open-source, diagnostic tool for analyzing Deep Neural Networks (DNN), without needing access to training or even test data. It is based on theoretical re…

https://calculatedcontent.com/2015/03/25/why-does-deep-learn...

What can they predict with the theory ?

Oh and here's a 2 hour deep dive into the theory https://bluejeans.com/playback/s/cyQnC9EZZSB9HlHDjB1Zpu3fs0J...

agreed!

That's fine. Here's a few of my online talks: UC Berkeley / ICSI: https://www.youtube.com/watch?v=6Zgul4oygMc Stanford ICME: https://www.youtube.com/watch?v=PQUItQi-B-I and a coupl…

Here's an alternative approach, that actually provides real world results https://calculatedcontent.com/2019/12/03/towards-a-new-theor... Using techniques from statistical mechanic…