Live data from Hacker News

DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

artificialanalysis.ai

101–110 of 342 posts

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#102
post #20

Earlier quoted context omitted.

I’ve been using v4 flash for an app I’m building [1] and it’s amazing how cost effective and good it is coming from having always used gpt, opus and sonnet models. It’s so cost effective I can offer a generous free tier since my goal isn’t to make money with it. [1] https://trysojourn.app

Is the difference between this and a frontier model that the scripture is guaranteed to be real? I'm on a team that develops a Bible study app, and we're all relatively content with how the basic models converse regarding scripture. Even as far back as GPT-4 was excellent. They occasionally have minor hallucinations (a dealbreaker for a production app), but they do an excellent job with theology and Bible scholarship…

I hope the irony of being concerned about hallucinations in a bible study app is not lost on you or others reading this!

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#103

Earlier quoted context omitted.

what plan are your 'fellow software engineers' using? I have a hard time even using up the Fable part of my allowance in a week of coding.

I'm not sure to be fair, but they do have constant "token anxiety", which I simply don't have anymore since using v4 flash.

why do they do if their employers are paying for it?

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#105

Earlier quoted context omitted.

By making companies using them "toxic" to touch. For example: no government contract to any company who uses even one vendor in it's entire chain of dependencies, who uses such open models. They can extend this further by laying more conditions, such as: any company dealing in this-this field can only use models "officially" approved as "safe". Rest you can guess how easy it would be to get that "safe" rating for suc…

Companies could self-host models in secret. It would be hard to stop.

Not legally. Liability is a big thing.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#106
Somewhat relatedly, how do the economics for Huggingface work? They must be hosting petabytes of models and datasets by now. I have downloaded quite a few “just in case”, only to replace them with the later iteration months later.

Does the file hosting actually cost peanuts when you do it yourself and the cloud has shattered my understanding of what it actually costs to deliver so much data?

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#107
post #40

Earlier quoted context omitted.

why would you get downvoted, that's one of the most obvious next step

Because reddit unironically has better decorum around usage of their upvote/downvote system than HN does. People on HN downvote objectively correct information because they don't like it 24/7. There's a reason the creator of Zig left and gave the computer version of a middle finger on the way out to HN!

You define OPs post as "objectively correct information" even though it is an unknown future event for which they provided zero evidence?

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#109

Somewhat relatedly, how do the economics for Huggingface work? They must be hosting petabytes of models and datasets by now. I have downloaded quite a few “just in case”, only to replace them with the later iteration months later. Does the file hosting actually cost peanuts when you do it yourself and the cloud has shattered my understanding of what it actually costs to deliver so much data?

Maybe download numbers are relatively low

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#110
post #98
post #37

here it is on openrouter https://openrouter.ai/deepseek/deepseek-v4-flash-0731

Half OT: Why do the cache hit rates seem to vary so much between harnesses? I use pi, which is very minimalist, and I get a hit rate of ~99%. Paying like $1 a day for Flash. Yet, the hit rate mentioned on OpenRouter is only ~79%.

Yes hit rate does vary by harness and by how you use the harness. If you use subagents, for instance, they will start with a whole new context created by the main agent, and this will not be cached. If you mostly use the main agent with Pi, you’ll have high hit rates and low costs. Sometimes agents do “cache busting” things where they’ll move around some of the text in the context to try to keep old instructions from being forgotten, thus keeping the agent on task, and this will bust the cache. I’ve heard, but not validated myself, that Open Code has some issues with this.

BTW, this is one of the things that I really like about Pi. It’s very simple and thus very predictable.

Post reply on HN