231–240 of 352 posts
Earlier quoted context omitted.
Please elaborate the mechanisms by which a LLM would know what model it is.
ask it what type of model it is or what it's name is... it's weird that Kimi will say it's claude...
The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
For what it’s worth, “race to the bottom” typically refers to a scenario that we absolutely do not want as a consumer. We do want a highly competitive market that drives prices down, but “race to the bottom” specifically refers to a scenario where firms compete by minimizing quality, regulatory oversight, consumer/labor/environmental protection, etc.
The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
The Chinese models are pretrained on large clusters just like OpenAI ones are. Yes, they use outputs of the frontier models to further improve the final model, but even without those outputs they'd still have very strong models.
It's not like in a world without distillation things would be much different as you claim.
Earlier quoted context omitted.
https://techcrunch.com/2026/04/30/elon-musk-testifies-that-x... Make sure to stay updated!
Nothing against what I said in there. Distillation is far from enough to get to the frontier. Its at best a ramp (the most efficient one used by everyone ) that shortcut and saves millions of rl runs before a model moves.
The fact that AI models can be so easily distilled and replicated is such a stroke of luck. 10 or 15 years ago if one had asked me to envision a future where a private company invents artificial intelligence, I'd have thought for sure they'd have a massive moat, be very difficult to catch, and it would create an almost instant monopoly. Rather, it seems that selling intelligence might end up as a race to the bottom.…
It's a mistake to think only OpenAI and Anthropic are actually spending the big bucks on pretrain, and the others just distill that. The Chinese models are pretrained on large clusters just like OpenAI ones are. Yes, they use outputs of the frontier models to further improve the final model, but even without those outputs they'd still have very strong models. It's not like in a world without distillation things would…
My prediction is that this becomes permanent. There is no good reason to be much more expensive than opus. At $4/$20 they are roughly at parity. Making 2/10 permanent would be a killer move and make a strong argument against open-weight. For the sake of the open weight ecosystem I hope they do not.
Earlier quoted context omitted.
Please elaborate the mechanisms by which a LLM would know what model it is.
ask it what type of model it is or what it's name is... it's weird that Kimi will say it's claude...
Once they make a model better than Fable I’ll be switching to Codex. Their priorities in terms of consumers seem to be better. I do think Anthropic has some solid safety viewpoints, but I don’t necessarily think that either is entirely aligned yet with delivering exactly what humanity needs. Maybe the AI will help align the AI companies when it gets smart enough. That’s the real misalignment I’m concerned about.
Fable 5 is just straight up a larger model - I'm guessing at this, but there is plenty of evidence online from people far more plugged in than I am. OpenAI is pursuing a strategy that yields greater operating margins and penetration of their model to developers. Fable's high cost makes it so premium that Anthropic has to reserve it for only the richest customers and corporate users. That's not a winning formula long…
Good timing. I'm not too happy having to pay MAX pricing to even access Fable, and I've had a couple situations where Fable missed things and GPT 5.6-Sol caught it. My needs are modest and I can get by on a $20 OpenAI subscription, so the odds are starting to look increasingly like I'm going to drop Anthropic altogether.