Live data from Hacker News

Show HN: I built a tiny LLM to demystify how language models work

github.com

91–100 of 174 posts

Re: Show HN: I built a tiny LLM to demystify how language models work

#92
post #86
post #50

[flagged]

Meaning/goal of life is to reproduce. Food (and everything else) is only a means to it. Reproduction is the only root goal given by nature to any life form. All resources and qualities are provided are only to help mating.

Then why are reproductive rates so low in western countries?

https://en.wikipedia.org/wiki/List_of_countries_by_total_fer...

Re: Show HN: I built a tiny LLM to demystify how language models work

#97
post #75

> A 9M model can't conditionally follow instructions How many parameters would you need for that?

My initial idea was to train a navigation decision model with 25M parameters for a Raspberry Pi, which, in testing, was getting about 60% of tool calls correct. IMO, it seems like around 20M parameters would be a good size for following some narrow & basic language instructions.

Ok. This makes me wonder about a broader question. Is there a scientific approach showing a pyramid of cognitive functions, and how many parameters are (minimally) required for each layer in this pyramid?

Re: Show HN: I built a tiny LLM to demystify how language models work

#99
post #92
post #86

Earlier quoted context omitted.

Meaning/goal of life is to reproduce. Food (and everything else) is only a means to it. Reproduction is the only root goal given by nature to any life form. All resources and qualities are provided are only to help mating.

Then why are reproductive rates so low in western countries? https://en.wikipedia.org/wiki/List_of_countries_by_total_fer...

The western lifestyle is an evolutionary dead end?

Re: Show HN: I built a tiny LLM to demystify how language models work

#100

Why are there so many dead comments from new accounts?

It really seems it's mostly AI comments on this. Maybe this topic is attractive to all the bots.

This title might have triggered something in those bots; most of them have sneaky AI SaaS links in their bio.

Honestly, I never expected this post to become so popular. It was just the outcome of a weekend practice session.

Post reply on HN