Live data from Hacker News

Show HN: Interactive, animated architecture of any HuggingFace models

modelmap.cc

11–20 of 20 posts

Re: Show HN: Interactive, animated architecture of any HuggingFace models

#11
post #8

I saw a similar page a month back. The design aesthetics are bit different https://hfviewer.com/

Oh nice, hadn't seen it. It looks good, and they've clearly got some decent stuff I don't (chrome extension, embedding in model cards, family pages).

The main difference appears to be how the graph gets made. From what I can tell they analyze the config on the server (their page says the first request can take a few minutes). I actually build the model on PyTorch's meta device and run a fake forward pass through it, so I get the real execution order and the tensor shapes at every module. That's what the animated replay and the compute/KV cache numbers are based on.

Re: Show HN: Interactive, animated architecture of any HuggingFace models

#13

extremely cool. I’ve had Claude walk model architectures to debug Loras and fine tunes, but this is delightful

I'd love to hear more about that. Are you able to fine tune specific layers?

Specifically, one particular otherwise excellent model I use has an alignment problem (sycophancy) that I've isolated to a specific layer. I can nuke the layer with lora and the behaviour stops - but I'm not sure what else I'm nuking in the process. I'm quite new at this so I'd love any advice. Thank you!

Post reply on HN