Viewing profile — robrenaud

Does the model quality become degraded in other ways?

Do consider the incentives of those developing the model that made those predictions. Afaict, it was not selected for purpose other than testimony.

How do you get personalization without surveillance?

I suspect idiomatic TypeScript or idiomatic F# are both way better solutions in the real world than abstruse Typescript emulating idiomatic F#.

If a good SWE is $150/hour, does the model cost actually matter? Surely you'd be willing to spend $10/hour to make that SWE 20% more productive? The model cost is still much less t…

They use a lightweight adapter to silently degrade the performance. Usually these adaptors are made to improve the performance for a given domain/task.

3 blue 1 brown has a great visual introduction to transformers, the heart of LLMs. It's chapter 5. Start at chapter 1 if you want more background on neural nets and backprop. https…

"The reasoning is the weights." The reasoning is in a process that uses the weights. Sorting algorithms are just bytes. Those bytes don't sort by themselves. They do instruct a com…

There is some recent work on modularizing knowledge in LLMs. https://arxiv.org/html/2605.06663v1 It might be possible to train a big generalist that is a composition of modules, so…

Is every American tax payer morally compromised?

My big gripe with unions is the unwavering protection of their worst performing members. Eg, that they necessitated so called "rubber rooms" like these in the NYC public schools, w…

The flat earthers are why I hate astronomy. Afaict, the grand parent poster is just very wrong. You do want to cause acute stresses to your heart (cardiovascular exercise) to get i…

Yeah, it's different. Anthropic profits when it delivers tokens. Hosting providers pay when Anthropic scrapes them.

Yeah, my big problem with the paper is it just might be an artifact of qwen's training process.

Was Alphago's move 37 original? In the last step of training LLMs, reinforcement learning from verified rewards, LLMs are trained to maximize the probability of solving problems us…

Recursive self improvement. It's when AI speeds up the development of the next AI.

Location: SF (current). NYC/Philly general area acceptable. Remote okay. email: rrenaud@gmail.com Resume: 16 year SWE -> MLE @ Google, MS from NYU with focus on ML. Retired. Now I …

What do y'all think about the latency/quality tradeoff with LLMs? Human voices don't take 30 seconds to think, retrieve, research, and summarize a high quality answer. Humans are c…

The Google style guide for C++/Java/Python are opinionated, hard fought, wise, and they elimate a large source of errors while minimizing harmful, unneded inconsistences. They pick…

Please serve well quantized models. If you can get 99 percent of the quality for 50 percent of the cost, that is most times a good tradeoff.

Cite a source. Your concrete claim is that, on average, for every $1 of subscription revenue on a monthly subscription, OpenAI and Anthropic were losing $11.50? It seems completely…

I used to play very competitively, but I've been more chill recently. I just think it's a nice problem/dataset to work with, because of the depth of my understanding of the game.

I’ve been experimenting with a live win probability predictor for the 10-player arcade game Killer Queen. The goal is to predict the winner in a causal, event-by-event fashion. Rig…

A compiler that can turn cash into improved code without round tripping a human is very cool though. As those steps can get longer and succeed more often in more difficult circumst…

Previously, I made a live win probability model for the 5v5 arcade game Killer Queen Arcade from their game events API. Now I am trying to use that model to make: 1. A post game in…