Live data from Hacker News

DeepSeek V4 – almost on the frontier

simonwillison.net

81–90 of 420 posts

Re: DeepSeek V4 – almost on the frontier

#81

While the cost are lower than frontier models there are two factors that make DS4 Pro and K2.6 not as cheap as they might look. For DS4 Pro there's a discount going on for the official API, which sometimes gets overlooked and mixed up in discussions. Simon uses the full price in the comparison, so that's not an issue here. The other issue is that DS4 Pro and K2.6 often use way more reasoning tokens than the frontier…

Sure that can happen but it hasn’t been my experience. I just spent a whole day using it for some pretty hefty refactors, many rounds of back-and-forths, thousands of lines of code changes, reviews, investigations, many subagents running parallel tasks, the works. Total cost $0.95, altogether. I had attempted this with Opus 4.6 in the past and it burned through the $10 budget I’d given it before it returned from my i…

Sounds promising, thanks for your report.

I didn't want to say that they're not cheaper to run, artificial analysis also shows that they're cheaper. My main point was about it being important to also look at token efficiency, not only cost per token, to get the full picture.

Re: DeepSeek V4 – almost on the frontier

#83

Earlier quoted context omitted.

Have you given GLM 5.1 or Kimi K2.6 a shot for coding? They outperform Deepseek v4 pro.

> Kimi K2.6 a shot for coding? They outperform Deepseek v4 pro I think this probably depends quite a bit on the specific problem. I'm finding that Deepseek v4 Flash often outdoes Kimi 2.6 on a variety of coding problems that involve complex spatial reasoning

Oh that's quite interesting and hasn't been my experience with regular backend code specifically with respect to tool calling. However that could be because the tool calling format in vllm for Deepseek v4 was broken until a few days ago and that's how I'm running it.

I've been hearing amazing things about Flash, I should give it a try.

Re: DeepSeek V4 – almost on the frontier

#85

I tried deepseek v4 through open code at the weekend. I'm a daily Claude/Claude code user. I tried to build something simple and while it got the job done the thinking displayed did not fill me with confidence. It was pages and pages of "actually no", "hang on", "wait that makes no sense". It was like the model was having a breakdown. Bear in mind open code was also new to me so I could be just seeing thinking where…

You can just use it through Claude Code, so you get to keep the system prompt and tooling you are used to.

3rd party models are a drop-in replacement with `ANTHROPIC_BASE_URL` in Claude Code, something people seem to miss right now. And contrary to what Anthropic might like to have you think, you don't need Opus 4.7 to run the harness to get similar performance.

https://api-docs.deepseek.com/quick_start/agent_integrations...

Re: DeepSeek V4 – almost on the frontier

#89
post #58

I tried deepseek v4 through open code at the weekend. I'm a daily Claude/Claude code user. I tried to build something simple and while it got the job done the thinking displayed did not fill me with confidence. It was pages and pages of "actually no", "hang on", "wait that makes no sense". It was like the model was having a breakdown. Bear in mind open code was also new to me so I could be just seeing thinking where…

Before CC and Codex removed thinking/verbose and hid most of it, both do that .

Yeah people aren’t aware that we don’t see the actual traces anymore lol

Re: DeepSeek V4 – almost on the frontier

#90
I've been using the planning framework from Matt Pocock on very typical brownfield code. I use a harness over claude code, this is so cheap that I would be tempted to mirror my initial prompt to it and compare their responses to the task.
Post reply on HN