Viewing profile — ImprobableTruth

The fundamental issue is that for these systems bigger is essentially always better (if affordable). So if we can squash something like Kimi K3 down to run on a 'normal' system, th…

This is not what the bitter lesson is about. It's not "don't develop better methods, just scale", it's that those methods which scale best win. LeCun's work is fundamentally about …

This is some bizarre victim inversion. The providers of closed models are the ones who are trying to use regulation to stop their open model competition, not the other way around.

Now, what if you order a construction crew for building your house? What if you also hire an architect to design the plan? And an overseer who manages everything? Surely at some po…

Sure, but "10x faster, but only applies on small greenfield, throwaway projects" is a major caveat. In fact, there's a good chance this doesn't disprove the original blog post, you…

Opus 4.5/4.6 are what many people consider the first 'good' models and it's from last year/start of this year. But fine, let's say everything before gpt 5.5 was unusable crap. Then…

>I just did a ~6 month project in ~2 weeks using a frontier model. Claims like this are hard for me to take seriously because 'good' models have been available since the start of t…

This is a very strange mindset. Even if you want to treat everything as sort of billable hours this doesn't really make sense because the average boss's boss's isn't paid anywhere …

Anthropic had to settle with authors because they literally pirated books! Their behavior regarding distillation is genuinely beyond parody.

Except it's not just a tool. It's when a woodworker, musician or painter completely outsources their work and just marks what's wrong, sending those parts back. Yes, the final art …

Shared memory of the past meant reserving a part of the memory for the GPU, which could then not be used or accessed by the CPU. If the CPU wanted to access something, it had to co…

If that was the real reason, why wouldn't they just make it so that if you don't correctly use caching you use up more of your limit?

The quill and ink at least communicates that it's about writing. The new one is so abstract that when I first looked at it I had no idea what I was even looking at, it certainly do…

The key thing is that you teach multiplication tables in a structured, incremental manner. Yes, it's just rote memorization, but the structure makes it way easier. You don't just d…

How is the raw Gemini 3 CoT accessed? Isn't it hidden?

They're not making money on inference alone because they blow ungodly amounts on R&D. Otherwise it'd be a very profitable business.

> These games are the starting point, but the bulk of the game is new puzzles combining mechanics from different games together Seems like the puzzles are novel, but the mechanics …

An almost 50% price increase. Benchmarks look nice, but 50% more nice...?

Unfortunately not, this model is noticeably worse. I imagine horizon is either gpt 5 nano/mini.

Even near-perfect LLMs would benefit from the compiler optimizations that types allow. However perfect LLMs would just replace compilers and programming languages above assembly co…

This is the fault of sloppy language. In Lean, _proofs_ (equivalent to functions) and _proof objects/certificates_ (values) need to be distinguished. You can't compute proofs, only…

Caveat: Coercions exist in Lean, so subtypes actually can be used like the supertype, similar to other languages. This is done via essentially adding an implicit casting operation …

I think the concept of a game DSL is cool, but it just feels so undercooked to me. Like, I'm a huge fan of gradual typing, especially TypeScript's, but gdscript's is just so primit…

What's the issue with the remix -> react-router transition? As far as I can tell it's just a branding thing.

I think the fact that all (good) LLM datasets are full with licensed/pirated material means we'll never really see a decent open source model under the strict definition. Open weig…