Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

youtube.com

Post reply on HN
Print view View original

31–40 of 51 posts

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#35

Post by DoingIsLearning »

vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

There are also different styles of teaching and learning. Karpathy always like to start from first principles and increment the building blocks.

Whereas for example Jeremy Howard's style resonates a lot more with how I enjoy learning, very much a "let's build it" and then tinker around to gain intuition on how things inside the box are working.

I see the benefit in both approaches and perhaps Karpathy is more methodical and robust. But I just find Howard's top-down style a lot easier to stay motivated with when I am learning on my own time.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#37

Post by janalsncm »

DoingIsLearning wrote: post #35
vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

There are also different styles of teaching and learning. Karpathy always like to start from first principles and increment the building blocks. Whereas for example Jeremy Howard's style resonates a lot more with how I enjoy learning, very much a "let's build it" and then tinker around to gain intuition on how things inside the box are working. I see the benefit in both approaches and perhaps Karpathy is more methodi…

Definitely agree. I think a lot of people get hung up on the math in ML but honestly there are so many other things you could spend time on, and there are opportunity costs for everything.

So I say, build the thing, figure out where the shortcomings in your knowledge are, and continue refining. One of those things will inevitably be math. Maybe it will be signals processing the next week or fundamentals of Spark the next. And there are always interesting papers coming out.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#38

Post by fransje26 »

arvinsim wrote: post #36

It frustrates me that I can't focus on these long-form videos when they are likely much better than the soundbite sized video counterparts.

Focus is cultivated.

If you want to start getting your focus back under control, give meditation a try. It's a gentle tool to will help you get you understand how your attention works, and, with training, will give you back the control you need.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#39

Post by attentionmech »

DoingIsLearning wrote: post #35
vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

There are also different styles of teaching and learning. Karpathy always like to start from first principles and increment the building blocks. Whereas for example Jeremy Howard's style resonates a lot more with how I enjoy learning, very much a "let's build it" and then tinker around to gain intuition on how things inside the box are working. I see the benefit in both approaches and perhaps Karpathy is more methodi…

Will checkout jeremy's lectures. I actually use his fastbook notebooks a lot to self-study.

Karpathy's style, for me is more like at the right abstraction to bring out curiosity in me towards the subject. After watching his lectures, i go on to more materials generally, and never really stop there.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#40

Post by vimgrinder »

janalsncm wrote: post #37
DoingIsLearning wrote: post #35

Earlier quoted context omitted.

There are also different styles of teaching and learning. Karpathy always like to start from first principles and increment the building blocks. Whereas for example Jeremy Howard's style resonates a lot more with how I enjoy learning, very much a "let's build it" and then tinker around to gain intuition on how things inside the box are working. I see the benefit in both approaches and perhaps Karpathy is more methodi…

Definitely agree. I think a lot of people get hung up on the math in ML but honestly there are so many other things you could spend time on, and there are opportunity costs for everything. So I say, build the thing, figure out where the shortcomings in your knowledge are, and continue refining. One of those things will inevitably be math. Maybe it will be signals processing the next week or fundamentals of Spark the…

I definitely avoided ML for years just due to math. But having a chatbot who can explain math with examples in any style you want defintely changed my opinion about math and ML in general. A big barrier to math is how it's written imo and not explained in a fun way with lot of examples. I certainly don't have a mathy brain, but I do get things when explained with examples (and certainly find it hard to come up with my own examples while fighting with the symbols).
Post reply on HN