Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

youtube.com

Post reply on HN
Print view View original

41–50 of 51 posts

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#41

Post by [deleted] »

karpathy wrote: post #8
ipsum2 wrote: post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

[deleted]

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#43

Post by Yajirobe »

vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

5. How to solve a Rubick’s cube

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#44

Post by cma »

orand wrote: post #31
tmp111111 wrote: post #7

Andrej, I like you much more now than when you were at Tesla. You have been adding real value to my life and many others. Thank you.

What is the relevance of Tesla to liking someone?

It may be that Karpathy was used in the AI day presentations to sell the idea that the cars would drive themselvesin a year and it was really important to pay $10,000 for it now (~2019?) before they raised the price.

We know from some of the leaked Musk/OpenAI emails they didn't really believe it internally and thought they would need to merge with OpenAI to do it.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#45

Post by bamboozled »

vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

"Neo of the matrix", what great analogy! Made my day and gave me a good laugh, thanks.

He is for sure a cool guy.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#46

Post by apetrov »

arvinsim wrote: post #36

It frustrates me that I can't focus on these long-form videos when they are likely much better than the soundbite sized video counterparts.

you don't have to do it in one go, i usually do pen and paper, 45m-1h of video time (~2h wall time) and often redo the same exercise a couple of months later

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#47

Post by carbine »

karpathy wrote: post #8
ipsum2 wrote: post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

thank you SO much for all your hard work, we sincerely appreciate it

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#48

Post by attentionmech »

bamboozled wrote: post #45
vimgrinder wrote: post #27

So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos: 1. minGPT, nanoGPT (transformers) 2. NLP (make more series) 3. tokenizers (his youtube) 4. RNN (from his blog) There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on M…

"Neo of the matrix", what great analogy! Made my day and gave me a good laugh, thanks. He is for sure a cool guy.

he has earned it haha.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#49

Post by browningstreet »

arvinsim wrote: post #36

It frustrates me that I can't focus on these long-form videos when they are likely much better than the soundbite sized video counterparts.

Serious suggestion: stand while you watch the video (Youtube on a TV helps here), use a pomodoro timer to do it in bits.

I also find I can watch a good bit of a complicated/technical video while walking on a treadmill/stairmaster at the gym. Just enough noise of other people, and the determination to do 45-60 minutes on a fitness machine replaces the determination required to get through a video. Doing it 3 days in a row feeds the motivation cycle in me. After day 1 I'm itching to get back to the gym and get back to the video to do another "episode".

Post reply on HN