Viewing profile — sosodev

Very true. Humans have historically tried to systematically reduce the search space and only dedicate their "compute" to things that seem highly likely to yield results.

I wonder why we have yet to see more systematic exploration of Math. Anthropic describes that Claude identified a set of possibilities and then explored them using sub-agents. The …

> Congratulations on being a vegan. 20% of the population doesn't have health insurance. These two things are completely unrelated.

I saw some coverage of your robot on social media. I honestly thought it was a hoax because of the very bold design and AI generated images. Cool concept, have you had any potentia…

> AISI provided the AI agents with internet access during these evaluations, which enabled their actions on the open internet in this setting. Internet access was a deliberate part…

Looks like I might have a reason to use something other than Deepseek V4 Flash.

I wonder how many people are using external resources when playing this. I have a hard time believing that the average lumps so far to the right of the score distribution unless th…

Are guard rails meaningful if they can be removed from the weights? Can America even prevent the release and proliferation of these models? It seems obvious to me that the whole qu…

They reference https://thinkingmachines.ai/blog/on-policy-distillation/ If I understand correctly, it's distillation via having a teacher model score each of the student's tokens f…

I think the argument is that decentralization leads to deceleration because it means less centralized funding and data. Those are the two primary ingredients for accel. The problem…

If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books. I have a hard time believing that text valuable to humans woul…

GSX seems interesting but I don’t understand why it depends on the node ecosystem. I just want to use Go for everything.

What would "actual" evidence look like? I have a hard time believing that if they released the logs that people would take it more seriously. The temptation would be to say "they f…

Realistically you can't prevent distillation. OpenAI / Anthropic are slowly moving towards hiding the steps in-between input and output (hidden thinking), but that only helps so mu…

Model distillation can't be stealing at all if you rationally apply copyright law to it. Anthropic is not deprived of Fable so there is no theft. At best it would be infringement, …

Distillation is a very vague term. It can mean anything from training exclusively on a model's output to using it for a very small portion of the training. In this case it is almos…

A month seems plenty long enough. They're not rebuilding the entire model from scratch. It's just getting Fable to act as a teacher model for some of the final reinforcement learni…

When? It literally says on the page for Gemini 3.6 Flash "Artificial Analysis Coding Index represents the weighted average of coding benchmarks in the Artificial Analysis Intellige…

What inference server are you using? They have a custom branch for llama.cpp, but I wouldn't be surprised at all if it still needs fixing.

Because AA Coding "Index" consists only of two benchmarks (Terminal-Bench v2.1, SciCode) and generally fails to be meaningfully representative of agentic coding capabilities.

That’s the worst thing about sycophancy. You can never tell when it’s warranted or not. I imagine that many AI chats have had real gold in them and yet we’ll never know. The same w…

Of course efficiency matters, but a lot of people either have cheap electricity or efficient hardware. My AMD strix halo home server can serve Gemma4-26B at like 70 TPS (rough esti…

They’re exaggerating or have a very simple way of using these models. The Gemma 4 series, even at 31B, is nowhere near the frontier. They’re great models, but you will notice a hug…

Qwen3.6-27B is the best model in that range that I’ve used for agentic coding by far. I think it’s kinda mid at everything else.

The Gemma models are so good at vision. It seems particularly important for phones. Also, they write in a much more pleasant manner than Qwen imo.