Neural network from scratch
sirupsen.com
Neural network from scratch
1–10 of 43 posts
Re: Neural network from scratch
#2"from scratch" but uses autograd and glosses over backpropagation.
Re: Neural network from scratch
#3"from scratch" but uses autograd and glosses over backpropagation.
import torch as scratch
from scratch import nnRe: Neural network from scratch
#4 import torch as scratch
from scratch import nnRe: Neural network from scratch
#5I remember doing this in PHP(4? 5?) for my undergrad capstone project because I had a looming due date and it was the dev environment I had readily available. No helpful libraries in that decade. Great way to really grok the material, and really lets me appreciate how spoiled we are today in the ML space.
Re: Neural network from scratch
#6For autograd from scratch, see https://github.com/karpathy/micrograd and/or
https://windowsontheory.org/2020/11/03/yet-another-backpropa...
Re: Neural network from scratch
#7Interesting find. Just FYI, this repo has been the OG for several years, when it comes to building NN from scratch:
Re: Neural network from scratch
#8"from scratch" but uses autograd and glosses over backpropagation.
He doesn't implement matrix operations, floating point addition / multiplication either.
Re: Neural network from scratch
#9I did this for my AI class. You can watch the result here:
https://www.youtube.com/watch?v=w2x2t03xj2A