https://bbycroft.net/llm has 3d Visualization of tiny example LLM layers that do a very good job at showing what is going on (https://news.ycombinator.com/item?id=38505211)
Show HN: I built a tiny LLM to demystify how language models work
61–70 of 174 posts
Re: Show HN: I built a tiny LLM to demystify how language models work
#62* How creating dataset? I download it but it is commpresed in binary format. * How training. In cloud or in my own dev * How creating a gguf
``` uv run python -m guppylm chat Traceback (most recent call last): File " ", line 198, in _run_module_as_main File " ", line 88, in _run_code File "/home/user/gupik/guppylm/guppylm/__main__.py", line 48, in main() File "/home/user/gupik/guppylm/guppylm/__main__.py", line 29, in main engine = GuppyInference("checkpoints/best_model.pt", "data/tokenizer.json") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^…
meybe add training again (read best od fine) and train again
``` # after config device checkpoint_path = "checkpoints/best_model.pt"
ckpt = torch.load(checkpoint_path, map_location=device, weights_only=False)
model = GuppyLM(mc).to(device) if "model_state_dict" in ckpt: model.load_state_dict(ckpt["model_state_dict"]) else: model.load_state_dict(ckpt)
start_step = ckpt.get("step", 0) print(f"Encore {start_step}") ```
Re: Show HN: I built a tiny LLM to demystify how language models work
#63Cool
Re: Show HN: I built a tiny LLM to demystify how language models work
#64How does this compare to Andrej Karpathy's microgpt (https://karpathy.github.io/2026/02/12/microgpt/) or minGPT (https://github.com/karpathy/minGPT)?
Re: Show HN: I built a tiny LLM to demystify how language models work
#65Re: Show HN: I built a tiny LLM to demystify how language models work
#66Great and simple way to bridge the gap between LLMs and users coming in to the field!
Re: Show HN: I built a tiny LLM to demystify how language models work
#67Why are there so many dead comments from new accounts?
Because despite what HN users seem to think, HN is a LLM-infested hellscape to the same degree as Reddit, if not more.
You’re absolutely right! HN isn’t just LLM-infested hellscape, it’s a completely new paradigm of machine assisted chocolate-infused information generation.
Re: Show HN: I built a tiny LLM to demystify how language models work
#68Re: Show HN: I built a tiny LLM to demystify how language models work
#69Earlier quoted context omitted.
Because despite what HN users seem to think, HN is a LLM-infested hellscape to the same degree as Reddit, if not more.
You’re absolutely right! HN isn’t just LLM-infested hellscape, it’s a completely new paradigm of machine assisted chocolate-infused information generation.
Just let me know which type of information goo you'd like me to generate, and I'll tailor the perfect one for you.
Re: Show HN: I built a tiny LLM to demystify how language models work
#70how did you generate the synthetic data?