Earlier quoted context omitted.
it's not really flash anymore, imo. Flash is about speed ... Flash models are supposed to be fast, way faster then their big brothers that are "better" but way slower. Its just that up to now, getting more speed involved cutting back on the parameter count, what ended up making the Flash models more "dumber" in exchange for speed. What we see with DS v4.1 Flash, is that DeepSeek has found a way to make a Flash model,…
> Companies who run locally, are perfectly able to buy a few H200/B200 and get a setup that run a model that almost rivals Opus 5.0 in their office. I agree with your broader point about Flash being about speed not total model size, but I think we should also point out that H200/B200's are seriously overkill for the "run a model in your office" scenario. That sort of hardware is optimized (in a roofline analysis sens…
I simply mention what came to mind ;)
A quad 6000 with 96GB, can run this model at NVFP4. That is 60.000 Euro for the GPUs and lets be generous with another 20.000 for the rest of the system. The price of a single developer for a year.