Live data from Hacker News

Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

youtube.com

21–30 of 51 posts

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#21
post #18
post #10

Earlier quoted context omitted.

Do you think videos disappearing is the biggest problem with YouTube from a distribution perspective?

Durability is not a Distribution problem.

I guess more in the problem of whether or not you consider it a good distribution platform, if you can't ascertain its durability.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#23
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

When he drops a vid, you don't ask questions. You watch first and then ask questions :)

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#24
post #8

Earlier quoted context omitted.

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

I haven’t watched this video yet, but do you plan to create any technical videos in the (1) series on RL in LLMs?

His intro to RL (not for LLM) blog post is a great read FYI

https://karpathy.github.io/2016/05/31/rl/

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#27
So much respect for this guy. He is like Neo of the matrix, bridging the gap between humans and machines. I have so far learned the following for free from his repos/videos:

1. minGPT, nanoGPT (transformers)

2. NLP (make more series)

3. tokenizers (his youtube)

4. RNN (from his blog)

There are many domains which don't have a karpathy and we don't hear about them. So glad we have this guy to spread his intuitions on ML.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#28
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

When he drops a vid, you don't ask questions. You watch first and then ask questions :)

I appreciated the question, because the video is 3hr30min long, and karpathy's answer here was helpful to know that it's not directed at me.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#29
post #8
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

Both are the best videos in NN and LLM. Your kindness is highly appreciated.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#30
post #8
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

"Something I could for example give to my parents,"

Not for nothing, Andrej's parents maybe different from mine, but I definitely can't send this to my parents.

Post reply on HN