Viewing profile — craq
craq
HN member- Joined
- Thu, Feb 29, 2024, 7:29 PM UTC
- HN karma
- 3
- Public activity
- 2 items
- HN profile
- View on Hacker News ↗
About craq
No profile information was provided.
Recent public activity
-
comment
Comment #39553996
And that's true, but why do they limit it to 100B tokens? And why not provide the loss curves in the end to show that both models have converged? What's not proven to me, in this p…
-
comment
Comment #39553897
And I was hoping to agree on this, but there is no 'SOTA StableLM-3b' with 2T tokens. Which is a big gap in the paper, because StableLM 3B is trained on 1T tokens for 4 epochs. And…