Anyone else find it weird how within 2 months of Fable releasing all the major labs suddenly had Fable-level models? Trying to think of explanations: 1) AI researchers talk and change companies often, so techniques circulate. This feels implausible because training and shipping a new model ought to take longer than 2 months? 2) Distillation - also implausible for the reason above. 3) Benchmark hacking. AI companies h…
Researchers moving between companies (and other ways that techniques get leaked) is the largest cause of this IMO. It's happening continuously, so I don't see why the timing makes it implausible. A really underrated strength of Silicon Valley is California's ban on non-competes that allows this to happen and ensures robust competition between model providers both for talent (increasing salaries for workers) and in the marketplace (reducing prices for consumers). If OpenAI had been located in New York instead then Anthropic could never have succeeded, for example.
But I think the other reason you didn't mention is the timing of new compute coming online. Compute is the major factor limiting the training of these models and new datacenter investments are bearing fruit at around the same time.