Live data from Hacker News

DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

artificialanalysis.ai

111–120 of 342 posts

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#111

[flagged]

I'm not looking forward to it, them being strapped for resources provides a huge incentive to develop and release these smaller models. Even if they'd still release their models once they are able to comfortably service all potential customers via their cloud, running them locally would be almost impossible due to their size.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#112

Earlier quoted context omitted.

Using tokens to evaluate models is an outdated approach. Cost per task is what matters. Not all tokens are created equal

Yes, but… more thinking tokens also means longer solution generation time. That said, v4 Flash is a fast model. I use it all the time because it’s very smart for the price. But it is verbose sometimes.

The thinking trace was (preview) frustrating to read, I think I'd prefer a summary view of it at this point.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#113

It’s exciting that a model scoring this high is dirt cheap. It’s also so inefficient, when they release the full performance numbers it’s not going to be good. One example, it takes about 3.6x more tokens to finish the same work as Gemini Flash 3.6.

Roughly equivalent to Gemini 3.6 Flash in capabilities at 1/20th the price...

Mind you, until the recent price cuts to Luna - Gemini 3.6 Flash wasn't even egregiously priced (but oh how things change in just 1 week).

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#114

Earlier quoted context omitted.

By making companies using them "toxic" to touch. For example: no government contract to any company who uses even one vendor in it's entire chain of dependencies, who uses such open models. They can extend this further by laying more conditions, such as: any company dealing in this-this field can only use models "officially" approved as "safe". Rest you can guess how easy it would be to get that "safe" rating for suc…

Companies could self-host models in secret. It would be hard to stop.

The thing is, you don’t need to actually block usage to make something illegal. You make it so toxic that company wants to be seen publicly using open models

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#115

I will get downvoted, but fck it. The ban on these open models is coming within weeks, if not days. As usual, the excuse will be "national security".

Hell, the US doesn't even need to act. I claim the CCP will wise up within 2 years, possibly much much sooner, and ban their own companies from open sourcing to prevent the Americans from acquiring the capabilities. Despite all the nonsense claims of China distilling US models, the reality is that the Americans absolutely do distill these free Chinese models, and distillation when full logprobs are available (i.e. yo…

I don't think it's necessarily "wiser" to go closed source. All of AI is built on mostly openness, at least on the software side. There are other ways to compete, it's just the model itself will be a commodity.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#116

The weights were just released a few minutes ago: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731

Hmm, it's targeting a HW accelerator with a 128x128 matmul primitive, which one is that? Warp Group Matrix Multiply Accumulate on H100?

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#117
post #20

Earlier quoted context omitted.

I’ve been using v4 flash for an app I’m building [1] and it’s amazing how cost effective and good it is coming from having always used gpt, opus and sonnet models. It’s so cost effective I can offer a generous free tier since my goal isn’t to make money with it. [1] https://trysojourn.app

Is the difference between this and a frontier model that the scripture is guaranteed to be real? I'm on a team that develops a Bible study app, and we're all relatively content with how the basic models converse regarding scripture. Even as far back as GPT-4 was excellent. They occasionally have minor hallucinations (a dealbreaker for a production app), but they do an excellent job with theology and Bible scholarship…

All models hallucinate. Everything in production with a model will too. It is not a "deal breaker"

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#119

Earlier quoted context omitted.

Companies could self-host models in secret. It would be hard to stop.

The thing is, you don’t need to actually block usage to make something illegal. You make it so toxic that company wants to be seen publicly using open models

Companies would secretly use self-hosted models internally because it would give them a enormous cost advantage.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#120

Earlier quoted context omitted.

I find that ChatGPT isn't censoring, but it is being pretty weaselly. If you ask it "is there genocide in gaza". It will say no but also say that a lot of organizations classify it as such. It will then say "it's highly disputed". If you poke it just a few times, however, you get to the point where it will eventually say (paraphrasing) that basically only Israel, the US state department, and the ICJ say it's not a ge…

One side of a conflict being a minority does not make it less nuanced. The majority of the world is religious - doesn’t mean the debate on religion isn’t a complex question. The majority of the world approved of slavery historically. The majority of countries have ethnically cleansed their Jews, many of them in living memory. When interrogated you will find that the only ones asserting the war in Gaza is a genocide a…

Are you a part of the $1B Israel is spending to try and propagandize and rehabilitate their reputation? [1]

I'm always suspicious that's the case given how mentions of gaza seem to bring out brand new accounts who only talk about Israel.

[1] https://quincyinst.org/research/the-eighth-front-inside-isra...

Post reply on HN