Viewing profile — natolambert

Code, math, charts, bibtex, and trying to make a tool that lets AI agents actually be useful in making slides. Would love feedback & testers!

ATOM: American Truly Open Models

Author here! Just wanted to say that this is indeed in a good place to share, some very useful stuff, but is also very work in progress. I'm may 60% or so to my first draft. Said p…

As the other commenter said, R1 required very standard RLHF techniques too. But a fun way to think about it is that reasoning models are going to be bigger and uplift the RLHF boat…

thx, you're right. I've fixed it!

Author here, you can find more on my website: https://natolambert.com/cv Have been building RLHF systems at HuggingFace since ChatGPT, with some other experience before.