Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

artificialanalysis.ai

Post reply on HN
Print view View original

121–130 of 342 posts

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#121

Post by hetspookjee »

vmt-man wrote: post #93
kamranjon wrote: post #65

Earlier quoted context omitted.

Can't wait for the DwarfStar quants - I have been using DeepSeek v4 flash (preview) as my main coding agent for months now (running on my 128gb mbp) - it seems this model outperforms GLM 5.2 on nearly every metric. Thanks for sharing the news, I was refreshing huggingface but gave up thinking it likely would take some more time.

are you working in earplugs? :)) even with 128 gigs of ram it must be super noisy.

the noise is pretty doable, and so is the heat, I find. I read these messages before I had the machine and expected far worse. The tok/s is for me the dealbreaker as I prefer to have multiple sessions. For nightly runs i do like it a lot, or to be a node in a mesh.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#122

Post by nancyminusone »

freakynit wrote: post #31
UltraSane wrote: post #29

Earlier quoted context omitted.

How exactly will they ban them?

By making companies using them "toxic" to touch. For example: no government contract to any company who uses even one vendor in it's entire chain of dependencies, who uses such open models. They can extend this further by laying more conditions, such as: any company dealing in this-this field can only use models "officially" approved as "safe". Rest you can guess how easy it would be to get that "safe" rating for suc…

Some contractors are already barred from using Claude due to DoD designation back in March as a "supply chain risk"

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#123

Post by lima »

0cf8612b2e1e wrote: post #106

Somewhat relatedly, how do the economics for Huggingface work? They must be hosting petabytes of models and datasets by now. I have downloaded quite a few “just in case”, only to replace them with the later iteration months later. Does the file hosting actually cost peanuts when you do it yourself and the cloud has shattered my understanding of what it actually costs to deliver so much data?

Bandwidth is really cheap when you run your own infra

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#124

Post by foltik »

weiliddat wrote: post #34
jmathai wrote: post #20

Earlier quoted context omitted.

I’ve been using v4 flash for an app I’m building [1] and it’s amazing how cost effective and good it is coming from having always used gpt, opus and sonnet models. It’s so cost effective I can offer a generous free tier since my goal isn’t to make money with it. [1] https://trysojourn.app

I get where you're coming from, and the intent to make it easier for people to find examples and verses, but there's a fine line with LLMs giving you answers, is that it's interpreting it in some form. Doesn't that run counter to prevailing ideology, that you're meant to either struggle with the materials / seek understanding yourself, or have your religious leaders interpret/receive those insights?

Just let them have their AI pacifier.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#125

Post by ReptileMan »

Flere-Imsaho wrote: post #70
baalimago wrote: post #15

New Deepseek models are like Christmas for me. Really big fan of low cost API models, noone does it better than DS. Until VRAM price is low enough to run models locally, this is the way to go. The subsidized subscription model won't last, API pricing "feels" closer to a true sustainable business model.

Indeed. My fellow software engineers keep complaining about using up all their Claude tokens within an hour... Whilst I'll be rocking DS flash for the entire day. Sure it gets a few things wrong here and there, but that's when you pull out the Claude models or whatever for those tricky tasks.

usually I am - Codex, make pi with deepseek to do something.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#126

Post by jmathai »

ComputerPerson wrote: post #82
jmathai wrote: post #20

Earlier quoted context omitted.

I’ve been using v4 flash for an app I’m building [1] and it’s amazing how cost effective and good it is coming from having always used gpt, opus and sonnet models. It’s so cost effective I can offer a generous free tier since my goal isn’t to make money with it. [1] https://trysojourn.app

Is the difference between this and a frontier model that the scripture is guaranteed to be real? I'm on a team that develops a Bible study app, and we're all relatively content with how the basic models converse regarding scripture. Even as far back as GPT-4 was excellent. They occasionally have minor hallucinations (a dealbreaker for a production app), but they do an excellent job with theology and Bible scholarship…

Philosophically, I don’t believe we should outsource the accuracy of scripture to any single entity (let alone a for profit secular one).

So it’s less about model choice and more about governance of scripture.

I will check out the link you sent for sure!

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#127

Post by ttul »

WithinReason wrote: post #116
coder543 wrote: post #41

The weights were just released a few minutes ago: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731

Hmm, it's targeting a HW accelerator with a 128x128 matmul primitive, which one is that? Warp Group Matrix Multiply Accumulate on H100?

Google TPUs are built around a 128×128 systolic array of multiply-accumulate (MAC) units. Trainium 1, Trainium 2, and Inferentia 2 also feature a 128x128 systolic array.

You learn something every day. Today, it was the term "systolic array": A systolic array is a specialized grid of simple, interconnected processing units designed to execute parallel data operations—like matrix multiplication—by rhythmically passing data directly from cell to neighboring cell without writing intermediate results back to main memory.

The term comes from the biological word systole (the contraction of the heart pumping blood through the body). In a systolic array, data "pulses" through a network of processing elements on every clock cycle, driven by a global clock beat.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#128

Post by dpacmittal »

dominotw wrote: post #101
dpacmittal wrote: post #91

[flagged]

[flagged]

I'm neither pro China, nor pro US. I'm pro open weights models, and I'm pro cheaper hardware. At this point I don't see any american frontier labs releasing SOTA open weights model, and I don't see ASML/Nvidia/Samsung monopoly getting any competition from anywhere apart from China in the near future.

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#129

Post by [deleted] »

Der_Einzige wrote: post #54
dgellow wrote: post #40

Earlier quoted context omitted.

why would you get downvoted, that's one of the most obvious next step

Because reddit unironically has better decorum around usage of their upvote/downvote system than HN does. People on HN downvote objectively correct information because they don't like it 24/7. There's a reason the creator of Zig left and gave the computer version of a middle finger on the way out to HN!

[deleted]

Re: DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis

#130

Post by ComputerPerson »

jmathai wrote: post #126
ComputerPerson wrote: post #82

Earlier quoted context omitted.

Is the difference between this and a frontier model that the scripture is guaranteed to be real? I'm on a team that develops a Bible study app, and we're all relatively content with how the basic models converse regarding scripture. Even as far back as GPT-4 was excellent. They occasionally have minor hallucinations (a dealbreaker for a production app), but they do an excellent job with theology and Bible scholarship…

Philosophically, I don’t believe we should outsource the accuracy of scripture to any single entity (let alone a for profit secular one). So it’s less about model choice and more about governance of scripture. I will check out the link you sent for sure!

I was under the impression you were getting BOOK.CHAPTER.VERSE references from the model and then sourcing them from a ground truth db.

Anyways, impressive app! We haven't tackled such an ambitious project just for it being daunting.

Post reply on HN