The two from parameter golf (one I trained, one was the baseline) are just 16MB each! They produce barely plausible English
Show HN: Visualizing Tiny LLMs from OpenAI's Parameter Golf
leebutterman.com