How can you reasonably try to get near frontier (even at all tps) on hardware you own? Maybe under 5k in cost?
More like 500k
DeepSeek v4
91–100 of 1001 posts
Re: DeepSeek v4
#92Earlier quoted context omitted.
How does it compare to Opus 4.7? I've been immersed in 4.7 all week participating in the Anthropic Opus 4.7 hackathon and it's pretty impressive even if it's ravenous from a token perspective compared to 4.6
It is more than good enough and has effectively caught up with Opus 4.6 and GPT 5.4 according to the benchmarks. It's about 2 months behind GPT 5.5 and Opus 4.7. As long as it is cheap to run for the hosting providers and it is frontier level, it is a very competitive model and impressive against the others. I give it 2 years maximum for consumer hardware to run models that are 500B - 800B quantized on their machines…
Vibes > Benchmarks. And it's all so task-specific. Gemini 3 has scored very well in benchmarks for very long but is poor at agentic usecases. A lot of people prefering Opus 4.6 to 4.7 for coding despite benchmarks, much more than I've seen before (4.5->4.6, 4->4.5).
Doesn't mean Deepseek v4 isn't great, just benchmarks alone aren't enough to tell.
Re: DeepSeek v4
#93Re: DeepSeek v4
#94Truly open source coming from China. This is heartwarming. I know if the potential ulterior motives.
if you want to understand why labs open source their models: http://try.works/why-chinese-ai-labs-went-open-and-will-rema...
Re: DeepSeek v4
#95Earlier quoted context omitted.
Is it honestly better than Opus 4.6 or just benchmaxxed? Have you done any coding with an agent harness using it? If its coding abilities are better than Claude Code with Opus 4.6 then I will definitely be switching to this model.
Their Chinese announcement says that, based on internal employee testing, it is not as good as Opus 4.6 Thinking, but is slightly better than Opus 4.6 without Thinking enabled.
That's super interesting, isn't Deepseek in China banned from using Anthropic models? Yet here they're comparing it in terms of internal employee testing.
Re: DeepSeek v4
#96MMLU-Pro: Gemini-3.1-Pro at 91.0 Opus-4.6 at 89.1 GPT-5.4, Kimi2.6, and DS-V4-Pro tied at 87.5 Pretty impressive
Funny how Gemini is theoretically the best -- but in practice all the bugs in the interface mean I don't want to use it anymore. The worst is it forgets context (and lies about it), but it's very unreliable at reading pdfs (and lies about it). There's also no branch, so once the context is lost/polluted, you have to start projects over and build up the context from scratch again.
Re: DeepSeek v4
#97Earlier quoted context omitted.
The thing is, it doesnt need to beat 4.7. it just needs to do somewhat well against it. This is free... as in you can download it, run it on your systems and finetune it to be the way you want it to be.
What's the hardware cost to running it?
I was curious, and some [intrepid soul](https://wavespeed.ai/blog/posts/deepseek-v4-gpu-vram-require...) did an analysis. Assuming you do everything perfectly and take full advantage of the model's MoE sparsity, it would take:
- To run at full precision: "16–24 H100s", giving us ~$400-600k upfront, or $8-12/h from [us-east-1](https://intuitionlabs.ai/articles/h100-rental-prices-cloud-c...).
- To run with "heavy quantization" (16 bits -> 8): "8xH100", giving us $200K upfront and $4/h.
- To run truly "locally"--i.e. in a house instead of a data center--you'd need four 4090s, one of the most powerful consumer GPUs available. Even that would clock in around $15k for the cards alone and ~$0.22/h for the electricity (in the US).
Truly an insane industry. This is a good reminder of why datacenter capex from since 2023 has eclipsed the Manhattan Project, the Apollo program, and the US interstate system combined...
Re: DeepSeek v4
#98Already on Openrouter. Pro version is $1.74/m/input, $3.48/m/output, while flash $0.14/m/input, 0.28/m/output.
Getting 'Api Error' here :(
Every other model is working fine.
Re: DeepSeek v4
#99Already on Openrouter. Pro version is $1.74/m/input, $3.48/m/output, while flash $0.14/m/input, 0.28/m/output.
https://openrouter.ai/deepseek/deepseek-v4-pro https://openrouter.ai/deepseek/deepseek-v4-flash
Its on OR - but currently not available on their anthropic endpoint. OR if you read this, pls enable it there! I am using kimi-2.6 with Claude Code, works well, but Deepseek V4 gives an error:
`https://openrouter.ai/api/messages with model=deepseek/deepseek-v4-pro, OR returns an error because their Anthropic-compat translator doesn't cover V4 yet. The Claude CLI dutifully surfaces that error as "model...does not exist"
Re: DeepSeek v4
#100Ah now !