Live data from Hacker News

Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

youtube.com

1–10 of 51 posts

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#6
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

From the description:

    I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version.
I think he has videos on building GPT2 from scratch, but this seems more high-level.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#8
post #3

He's made more than 5 videos covering basically the same topic, of transformer architecture and training. Wonder whats different about this one?

My YouTube videos fall into two tracks:

1. technical track (all the GPT repro series)

2. general audience track

For (2), I had a 1hr video from 1 year ago, but I didn't actually expect that video to be some kind of authoritative introduction to LLMs. The history is that I was invited to give an LLM talk (to general audience), prepared some random slides for a day, gave the talk, and then re-recorded the talk in my hotel room later in a single take, and that become the video. It was quite random and haphazard. So I wanted to loop back around more formally and do a more comprehensive intro to LLMs for general audience; Something I could for example give to my parents, or a friend who uses ChatGPT all the time and is interested in it, but doesn't have the technical background to go through my videos in (1). That's this video.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#9
post #5

I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.

You can just make a torrent of the video. It will then survive as long as you/others are willing to seed it.

Re: Andrej Karpathy: Deep Dive into LLMs Like ChatGPT [video]

#10
post #5

I wish there were another way to distribute video. Content disappears from youtube eventually, for silly reasons. I think this is important content, the more people know how ai works under the hood the more empowered society will be.

Do you think videos disappearing is the biggest problem with YouTube from a distribution perspective?
Post reply on HN