Viewing profile — red2awn

I have exactly the same thought. Anyone who had used seedance 2.0 a bit can tell Gemini is a bit behind, and seedance 2.1 is on the horizontal already.

LLM-as-a-judge is quite effective method to RL a model, similar to RLHF but more objective and scalable. But yes, anthropic is making it more serious than it is. Plus DeepSeek only…

The "distillation attacks" are mostly using Claude as LLM-as-a-judge. They are not training on the reasoning chains in a SFT fashion.

What's the SOTA open source or weight available turn taking model these days? I tried pipecat/smart-turn-v3 and the results are not good. It only works well when you say a short se…

Distilling from a teacher (Opus 4.5) and scaling RL more.

> i need to wash my helicopter at the helicopter wash. it is 50m away, should i walk or fly there with my helicopter. Sonnet 4.6: Walk! Flying a helicopter 50 metres would be more …

It was mentioned that the performance of DuckDB is similar to that of Polars (among others). In that case why would one choose DuckDB over Polars? The only differentiator seems to …

They are heavily focused on code. Claude Code likely generates 100 of millions lines of Python a day, make the language a little bit better with $1.5M is extremely high leverage.

Implement transformers yourself (ie in Numpy). You'll never truly understand it by just watching videos.

It does NOT. Response healing only fixes JSON syntax errors, not schema differences. See https://news.ycombinator.com/item?id=46332119

Tokens are sampled from logits using the constraints after a normal forward pass. The forward pass is the expensive part of LLM inference which isn't affected by structured output.…

Cool stuff! I don't get how all the open source inference framework have this down but the big labs doesn't... Gemini [0] is falsely advertising this: > This capability guarantees …

Very confused. When you enable structured output the response should adhere to the JSON schema EXACTLY, not best effort, by constraining the output via guided decoding. This is eve…

Very interesting release: * Hybrid MoE: 2-3x faster than pure MoE transformers * 1M context length * Trained on NVFP4 * Open Source! Pretraining, mid-training, SFT and RL dataset r…

Opus 4.5 is the highest quality code I've seen out of LLMs, still some way to go to match programmers who care, but much better than most people. I find it enough to let it write t…

Claude Code does not support AGENTS.md, you can symlink it to CLAUDE.md to workaround it. Anthropic: pls support!

Correct, it's breaks the single prompt, single completion assumption baked into the frameworks. Conceptually it's still prompt/completion but for low latency response you have to d…

Nice work. Are you working on streaming input/output?

Why would you use an Omni model for text only workload... There is Qwen3-30B-A3B.

They had a Flash variant released alongside the original open weight release. It is also mentioned in Section 5 of the paper: https://arxiv.org/pdf/2509.17765 For the evals it's pr…

It is an in-house closed weight model for their own chat platform, mentioned in Section 5 of the original paper: https://arxiv.org/pdf/2509.17765 I've seen it in their online mater…

Flash is a closed weight version of https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct (it is 30B but with addtional training on top of the open weight release). They deploy t…

None of inference frameworks (vLLM/SGLang) supports the full model, let alone non-nvidia.

The previous -Flash weight is closed source. They do have weights for the original model that is slightly behind in performance https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instr…