Viewing profile — thatguysaguy

Scott's parenting posts are some of his best

The contrast between the example screenshots and the standard internet behavior in the live demo is hilarious

The python overhead of launching big ML jobs is nontrivial, so I think speeding that up would be meaningful. (I mean the initial tracing and other setup, not things once the GPUs a…

It looks like people in this thread are confusing fleet utilization and MFU. If they're doing a lot of RL, it's really not surprising to see such low numbers.

That's b/c the people working on Gemini serving are in GDM.

What sort of workloads are you thinking of?

What is up with people saying you cannot prove a negative? Of course you can! (At least in formal settings) For example it's extremely easy to prove there is no square with diagona…

Ah dang. When I did this I also thought the length bug was intentional but I didn't figure it out before I started my new job, so I dropped the puzzle.

Maybe I missed something, but I see little evidence that there is a concerning ability to deanonymize. Many people post under a pseudonym but then link to their GitHub etc. In fact…

You can just try other svgs, I got some pretty good ones. (*Disclaimer: I work for Google, but also I have zero idea about what they trained deepthink on)

TPUs predate LLMs by a long time. They were already being used for all the other internal ML work needed for search, youtube, etc.

I'm actually not talking about whether the PR works or was tested. Let's just assume it was bug-free and worked as advertised. I would say that even in that situation, they should …

A big part of software engineering is maintenance not just adding features. When you drop a 22,000 line PR without any discussion or previous work on the project, people will (prob…

It's a volunteer run project... Saying that they have a duty to do anything other than what they want is quite strange.

Verification via LLM tends to break under quite small optimization pressure. For example I did RL to improve against one of the sota models from one generation ago, and the (quite …

FAIR is not older AI... They've been publishing a bunch on generative models.

Back when BERT came out, everyone was trying to get it to generate text. These attempts generally didn't work, here's one for reference though: https://arxiv.org/abs/1902.04094 Thi…

I would recommend going and reading what the BlueSky leadership actually wrote, rather than this post's summary of it.

Why would you think that deepseek is more efficient than gpt-5/Claude 4 though? There's been enough time to integrate the lessons from deepseek.

37 billion bytes per token? Edit: Oh assuming this is an estimate based on the model weights moving fromm HBM to SRAM, that's not how transformers are applied to input tokens. You …

Joel's blog in general is an extremely great read. I highly recommend subscribing.

At least part of is is that the capex for LLM training is so high. It used to be that compute was extremely cheap compared to staff, but that's no longer the case for large model t…

I both got a job through such a thread, and have now seen the other side of the applicant pipeline. The average applicant (in general, idk about HN in particular) is not very stron…

> Do you think the students in that poll had really thought about the credibility of their university when voting? That's fair, and I'm not sure of course. I guess a more interesti…

I think the author doesn't understand the example correctly, although to be fair I don't think the professor put the most important option on there either. Imagine there are two sc…