LLM Visualization
bbycroft.net
LLM Visualization
1–10 of 138 posts
Re: LLM Visualization
#2Damn, this looks phenomenal. I've been wanting to do a deep dive like this for a while-- the 3D model is a spectacular pedagogic device.
Re: LLM Visualization
#3Incredible work.
So much depth; initially I thought it's "just" a 3d model. The animations are amazing.
Re: LLM Visualization
#4I feel like visualizations like this are what is missing from univeristy curricula. Now imagine a professor going trough each animation describing exactly what is happening, I am pretty sure students would get a much more in-depth understanding!
Re: LLM Visualization
#5Really cool!
Re: LLM Visualization
#6First off, this is fabulous work. I went through it for the Nano, but is there a way to do the step-by-step for the other LLMs?
Re: LLM Visualization
#7Super cool! It's always nice to look something concrete
Re: LLM Visualization
#8[deleted]
Re: LLM Visualization
#9First off, this is fabulous work. I went through it for the Nano, but is there a way to do the step-by-step for the other LLMs?
Below the title, there's a few others you can choose from (GPT-2 small and XL and GPT-3)
Re: LLM Visualization
#10This is an excellent tool to realize how an LLM actually works from the ground up!
For those reading it and going through each step, if by chance you get stuck on why 48 elements are in the first array, please refer to the model.py on minGPT [1]
It's an architectural decision that it will be great to mention in the article since people without too much context might lose it
[1] https://github.com/karpathy/minGPT/blob/master/mingpt/model....