11–20 of 71 posts
A little offtopic, but is this something that someone with only webdev experience can get started with?
There are several open courses, online.
A little offtopic, but is this something that someone with only webdev experience can get started with?
Wonderful! Just went through the GPT video the other day and it was great. Andrej has a talent for pedagogy via simplification.
Which GPT Video?
Let's build GPT: from scratch, in code, spelled out: https://www.youtube.com/watch?v=kCc8FmEb1nY
Also, the way he builds up everything is magnificent. Starting from basic python classes, to derivatives and gradient descent, to micrograd [2] and then from a bigram counting model [3] to makemore [4] and nanoGPT [5]
[1]: https://www.foundersandcoders.com/ml
[2]: https://github.com/karpathy/micrograd
[3]: https://github.com/karpathy/randomfun/blob/master/lectures/m...
A little offtopic, but is this something that someone with only webdev experience can get started with?
I'm doing an ML apprenticeship [1] these weeks and Karpathy's videos are part of it. We've been deep down into them. I found them excellent. All concepts he illustrates are crystal clear in his mind (even though they are complicated concepts themselves) and that shows in his explanations. Also, the way he builds up everything is magnificent. Starting from basic python classes, to derivatives and gradient descent, to…
I’ve been simply watching them on a palm from a hammock and I’m worried I’m not getting the full experience.
What I appreciate about karpathy's videos is that it doesn't make things any more complicated than they need to be. Simple, engineering language is used. No gatekeeping! It's reassuring, and lets everyone know that anyone can do it. Thanks karpathy!
I'm doing an ML apprenticeship [1] these weeks and Karpathy's videos are part of it. We've been deep down into them. I found them excellent. All concepts he illustrates are crystal clear in his mind (even though they are complicated concepts themselves) and that shows in his explanations. Also, the way he builds up everything is magnificent. Starting from basic python classes, to derivatives and gradient descent, to…
Do you run the code as you watch? I’ve been simply watching them on a palm from a hammock and I’m worried I’m not getting the full experience.
What I appreciate about karpathy's videos is that it doesn't make things any more complicated than they need to be. Simple, engineering language is used. No gatekeeping! It's reassuring, and lets everyone know that anyone can do it. Thanks karpathy!
I just don’t know what he means by logits. Everything else seems like straightforward language.
https://deepai.org/machine-learning-glossary-and-terms/logit....
edit: Python really was/is made for this numbers/calculation/visualization thing. Kinda kicking myself now for not investing more in it and sticking with PHP, although PHP has its merits when building different things, Python is a beast with numbers.