The Illustrated Stable Diffusion
jalammar.github.io
The Illustrated Stable Diffusion
1–10 of 128 posts
Re: The Illustrated Stable Diffusion
#2So its like the How to Draw an Owl meme.
Re: The Illustrated Stable Diffusion
#3Nope, still don't understand it. :-/
Re: The Illustrated Stable Diffusion
#4So its like the How to Draw an Owl meme.
SD has made this meme into a reality, given how easy it is to take a sketch and use img2img to get something workable out of it.
Re: The Illustrated Stable Diffusion
#5Closer. But I still get lost when words like “tensor” are used. “structured lists of numbers” really doesn’t seem to explain it usefully.
This reminds me that explaining seemingly complex things in simple terms is one of the most valuable and rarest skills in engineering. Most people just can’t. And often because they no-longer remember what’s not general knowledge. You end up with a recursive Feynmannian “now explain what that means” situation.
This is probably why I admire a whole bunch of engineering YouTubers and other engineering “PR” people for their brilliance at making complex stuff seem very very simple.
Re: The Illustrated Stable Diffusion
#6Hugging Face's diffusers library and explainer Colab notebook (https://colab.research.google.com/github/huggingface/noteboo...) are good resources on how diffusion works in practice codewise.
Re: The Illustrated Stable Diffusion
#7Love the visual explainers for machine learning nowadays.
The author has more here: https://jalammar.github.io/
Amazon has some highly interactive ones here: https://mlu-explain.github.io/
Google had: distill.pub
Hope to see education in this space grow more.
Re: The Illustrated Stable Diffusion
#8This is the perfect level of description, thank you. Looking forward to checking out more of your work.
Re: The Illustrated Stable Diffusion
#9Closer. But I still get lost when words like “tensor” are used. “structured lists of numbers” really doesn’t seem to explain it usefully. This reminds me that explaining seemingly complex things in simple terms is one of the most valuable and rarest skills in engineering. Most people just can’t. And often because they no-longer remember what’s not general knowledge. You end up with a recursive Feynmannian “now explai…
If it helps you to understand at all, assuming you have a CS background, any time you see the word "tensor" you can replace it with "array" and you'll be 95% of the way to understanding it. Or "matrix" if you have a mathematical background.
Whereas CS arrays tend to be 1 dimensional, and sometimes 2 dimensional, tensors can be as many dimensions as you need. A 256x256 photo with RGB channels would be stored as a [256 x 256 x 3] tensor/array. If you want to store a bunch of them? Add a dimension to store each image. Want rows and columns of images? Make the dimensions [width x height x channels x rows x columns].
Re: The Illustrated Stable Diffusion
#10Everytime I need a refresher on transformers, I read the same author's post on transformers. Looking forward to this one!