Earlier quoted context omitted.
Geometric mean of all these benchmarks : * GPT-5.6 Sol: 65.5 * Fable 5 (w/ fallback): 64.5 * Opus 5: 64.0 * DS-V4-Pro 0813: 62.5 * Kimi-K3: 62.3 * DS-V4-Flash 0731: 55.8 * GLM-5.2: 47.3
Maybe it's me but I don't see how DS Flash is better than GLM at all, much less by a huge gap. I'd probably protest less against Fable and Opus being put at the same level than many would, but there's no denying the two models are a very different experience from each other. I guess where I'm going is no one should pick a model by the benchmarks.
DeepSeek V4 Pro 0813
111–120 of 493 posts
Re: DeepSeek V4 Pro 0813
#112I find it interesting how much adoption seems to be influenced by momentum. Some of these Chinese models are surprisingly capable, but developers often default to the models that are already established as the “industry standard
If it's 500x cheaper than US models for similar ballpark performance just because it's hosted in China, sure whatever. If it's name brand like Anthropic/OpenAI/Google, that's kinda fine too.
If it's neither, like merely 50% cheaper than latest OpenAI whatever, however massive loss that pricing may be incurring to its provider, it wpuld be considered not worth any attention.
Re: DeepSeek V4 Pro 0813
#113Currently burning money quickly on official deepseek api. They are also increasing pricing starting today. V4 Flash 0731 still feels like the most outstanding model of the past few months and probably to come.
yup :) i'm doing opencode openrouter official deepseek api (i don't get the opencode hate, i like it) how are you doing it? am also using Kimi K3 via kimi-code and also GLM 5.2 via ZCode happy with all three, they're trailing frontier but i figure if i'm running GNU/Linux then i ought to favour open weights models with my €s -- reduced my usage of claude/gpt to the ~$20 tier just to keep abreast of claude_code/codex…
When the company I work for was evaluating it, there were multiple rough points. Their terms and conditions allowed training on prompts, the default behavior was to route prompts to their servers for conversation summary/labeling. One of their lead maintainers is also super toxic on many issues.
Sorry this is all baseless with no links, I’m on my phone and locating those issues again isn’t something I have time for.
It’s a good tool I just don’t like the privacy policies nor maintainers attitudes.
Re: DeepSeek V4 Pro 0813
#114Earlier quoted context omitted.
This but unironically
[flagged]
Re: DeepSeek V4 Pro 0813
#115@dang - Pls merge this with https://news.ycombinator.com/item?id=49274018
Re: DeepSeek V4 Pro 0813
#116Earlier quoted context omitted.
+1, a single test means little.
I don't think so. I specifically kept this PR to test model capabilities, and I've already tested a bunch of models. Current test results show that the more advanced the model is, the easier it passes. For example, GPT-5.5 Medium fails the test(has bug), but High passed.
Re: DeepSeek V4 Pro 0813
#117Tested both DS v4 pro 0813 and Grok 4.6 (all from openrouter) on Codex cli. Worked on a same new feature development on my project. Deepseek 4 pro: Worked for 12m 02s - cost $0.12 - has bug. Grok 4.6: Worked for 3m 18s - cost $ 1.41 - no bug.
Re: DeepSeek V4 Pro 0813
#118I've been using the last Deepseek Flash update for a week and I'm amazed. It was a capable model for easy tasks but now it looks like it can do some heavy development for peanuts. I can't wait to try this new one.
Re: DeepSeek V4 Pro 0813
#119Just tested through openrouter.. gave exactly same task.. the task was to scan existing repo, and generate a single docker-compose file to deploy behind a caddy server, where certain port ranges are already used, the service demands widlcard certificates to be provisioned from outside, and postgre needs to be built-in one... Tested this model, and gpt-5.6-terra-high. Results: this one had few issues. terra: none. The…
LLMs make containers in a pretty workable format for me (still hand tweak the env variables for a sanity check).
How exactly does it struggle here and why does postgres need to be built? Were the needs beyond what you get in a base image?
Re: DeepSeek V4 Pro 0813
#120Earlier quoted context omitted.
https://api-docs.deepseek.com/quick_start/pricing/ edit: there are banner announcements saying v4 flash pricing will increase first then overall by an undetermined amount
i dont see any price increase there... what am i missing?