Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

Post by Dinux » Wed, Feb 05, 2025, 9:20 PM UTC

demarq wrote: post #5

I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.

Post by amelius » Wed, Feb 05, 2025, 9:23 PM UTC

gdjdkslslp wrote: post #11

karpathy wrote: post #8

Earlier quoted context omitted.

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

I haven’t watched this video yet, but do you plan to create any technical videos in the (1) series on RL in LLMs?

Post by [deleted] » Wed, Feb 05, 2025, 9:32 PM UTC

karpathy wrote: post #8

ipsum2 wrote: post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…

Post by demarq » Wed, Feb 05, 2025, 10:29 PM UTC

m_ppp wrote: post #10

demarq wrote: post #5

I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.

Do you think videos disappearing is the biggest problem with YouTube from a distribution perspective?

Post by gnunez » Wed, Feb 05, 2025, 10:44 PM UTC

karpathy wrote: post #8

ipsum2 wrote: post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks: 1. technical track (all the GPT repro series) 2. general audience track For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my ho…