Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
1–10 of 51 posts
Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#2Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#3Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#4Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#5I think this is important content, the more people know how ai works under the hood the more empowered society will be.
Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#6He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?
I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version.
I think he has videos on building GPT2 from scratch, but this seems more high-level.Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#7Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#8He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?
1. technical track (all the GPT repro series)
2. general audience track
For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my hotel room later in a single take, and that become the video. It was quite random and haphazard. So I wanted to loop back around more formally and do a more comprehensive intro to LLMs for general audience; Something I could for example give to my parents, or a friend who uses ChatGPT all the time and is interested in it, but doesn't have the technical background to go through my videos in (1). That's this video.
Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#9I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.
Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]
#10I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.