This course together with the new fastai ones [1] seem to be exactly what I was looking for. The micrograd video is excellent.
Neural Networks: Zero to Hero
21–30 of 71 posts
Re: Neural Networks: Zero to Hero
#22I'm doing an ML apprenticeship [1] these weeks and Karpathy's videos are part of it. We've been deep down into them. I found them excellent. All concepts he illustrates are crystal clear in his mind (even though they are complicated concepts themselves) and that shows in his explanations. Also, the way he builds up everything is magnificent. Starting from basic python classes, to derivatives and gradient descent, to…
That program sounds quite impressive, I wonder if any equivalencies exist in the US?
Re: Neural Networks: Zero to Hero
#23Earlier quoted context omitted.
Do you run the code as you watch? I’ve been simply watching them on a palm from a hammock and I’m worried I’m not getting the full experience.
I've found that actually running the code has been very beneficial in understanding. This, along with reasoning for each line of code and spending a lot of time with the video paused and discussing and explaining to each other what we understood.
Same. I also found the exercises to be useful.
Re: Neural Networks: Zero to Hero
#24A little offtopic, but is this something that someone with only webdev experience can get started with?
The tools are basically irrelevant conceptually. Its all about the mathematics
Re: Neural Networks: Zero to Hero
#25Wonderful! Just went through the GPT video the other day and it was great. Andrej has a talent for pedagogy via simplification.
And he presents all this stuff with humility. Many people that present are just showing off and are pretty much full of themselves. I suppose they need the ego boost, who knows. But Andrej could be the nice guy next door in the dorm who is studying the same course as you, just that hr is a lecture or two ahead. (Until you figure out he is the former VP of AI at Tesla or whatever his title ended up being before he lef…
Only finished the first video, but he even made two minor blunders in his code, but kept the footage. Really helps your confidence when you see a pro make a mistake rather than a perfectly polished but unattainable ideal standard.
Re: Neural Networks: Zero to Hero
#26A little offtopic, but is this something that someone with only webdev experience can get started with?
You need some fluency in python and basic knowledge of algebra (matrix multiplication etc.)
If you want, you can also start with the first lessons of course.fast.ai
Re: Neural Networks: Zero to Hero
#27Andrej’s course is brilliant and so nice to follow.
His explanation of attention is the most accessible I have ever seen.
Re: Neural Networks: Zero to Hero
#28This was the first time I actually grokked backpropagation, just the first video alone is more lucid and valuable than any other resource about machine learning I had seen before, in fact it's so well explained that i managed to implement the library almost completely from memory after watching it - I cannot recommend it highly enough, especially for programmers without a math background! The only aspect I could see…
To be fair, the older Andrew Ng’s online course was also fantastic to explain backprop.
But this does not remove any credit to Andrej’s class.
Re: Neural Networks: Zero to Hero
#29I'm doing an ML apprenticeship [1] these weeks and Karpathy's videos are part of it. We've been deep down into them. I found them excellent. All concepts he illustrates are crystal clear in his mind (even though they are complicated concepts themselves) and that shows in his explanations. Also, the way he builds up everything is magnificent. Starting from basic python classes, to derivatives and gradient descent, to…
That program sounds quite impressive, I wonder if any equivalencies exist in the US?
The website doesn't say what—for me—is the best thing about it. The course is peer-led which works like this: once your join, you're part of a team which has one objective: get the best score with your ML recommendation system.
There is simulated environment in which all teams of the cohort receive millions of requests per day (and hundreds of thousands of users and items) and you have to build out your infrastructure on an EC2 instance, build a basic model, and then iteratively improve on it. Imagine a simulated facebook/youtube/tiktok-style system where you aim for the best uptime and the best recommendations!
Re: Neural Networks: Zero to Hero
#30Wonderful! Just went through the GPT video the other day and it was great. Andrej has a talent for pedagogy via simplification.
And he presents all this stuff with humility. Many people that present are just showing off and are pretty much full of themselves. I suppose they need the ego boost, who knows. But Andrej could be the nice guy next door in the dorm who is studying the same course as you, just that hr is a lecture or two ahead. (Until you figure out he is the former VP of AI at Tesla or whatever his title ended up being before he lef…
He also is quite good at teaching and solving the Rubik's cube