Live data from Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

mimo.xiaomi.com

111–120 of 512 posts

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#111

Earlier quoted context omitted.

I see bigger problem with model inconsistency. You never know whether Anthropic will route your request to a cheaper model for the price of Opus. So you can never estimate how much a task will cost, because you might have to restart several times and pay for each attempt. Then you have to prompt models to gauge whether they are real or impostors which also adds to token usage.

> You never know whether Anthropic will route your request to a cheaper model for the price of Opus For non subsidized plans? Pretty sure they'd need to put this in ToS, or law suites would have followed by now.

How can you prove it?

Sometimes Opus just gives me a rubbish session.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#112

Earlier quoted context omitted.

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

Do you mean Flash and not Pro? I haven't tried it personally, but according to OpenRouter, the fastest DeekSeep V4 Pro providers are only ~50tps. That's slower than Claude Opus. https://openrouter.ai/deepseek/deepseek-v4-pro?sort=throughp...

Yeah, flash is crazy fast, but I've found performance variable.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#113
post #76
post #17

These price and speed optimization from Chinese providers, combined with the raising prices from American ones will change the game sooner than later. Many companies are finding issues with the AI bills already.

Another problem is that US models are all closed source, and if you're a large corporate you may not want your org to be held hostage by OpenAI / Anthropic. I genuinely don't understand what moat these US model labs have. If they're saying recursive self improvement is just around the corner and Chinese labs are only slightly behind the leading US models, what moat does the US labs have? Are the US models going to re…

Their moat is cash to pay politicians to regulate away competition.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#114
post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

This reminds me of the Peter / Boris comments on writing loops to keep the agents busy.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#115

Earlier quoted context omitted.

The Chinese "Neijuan" is real & well reported: https://www.reuters.com/business/autos-transportation/what-i... It is another thing the BigLabs accuse open weight models of benefiting from distillation & other techniques & essentially avoid higher training costs (which typically bleed into bills end users pay for inference). Ex A: https://www.anthropic.com/research/2028-ai-leadership Ex B: https://www.reuters.com/worl…

We buy cheap Chinese goods all the time. Absolutely nothing wrong with that. In this case, at least it’s threatening multimillion dollar salary jobs instead of entire towns of working class people in America or Mexico. And the Chinese labs actually release their weights. You could call it… open AI.

Lololol.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#116

Earlier quoted context omitted.

I wonder what are the economics driving these pricing decisions? Are the Chinese companies just subsidizing their models to a greater degree than the US, or is this an emergent property of energy policy between countries?

Throwing out another factor: Chinese companies have been banned and/or limited from buying nvidia, and turned to local companies for their hardware. I haven't actually seen pricing/benchmarks comparing Chinese AI accelerators, but it wouldn't surprise me if that also worked out in their favor as well.

And, possibly, state subsidies at every level.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#118
Obligatory taalas mention:

https://taalas.com/

Despite the performative UI components they have a shipped (demo) product:

https://chatjimmy.ai/

This is only 3.1 8B and a very small context window, but at 17k tokens per second it's likely enough to reliably call tools which would make a huge difference in agentic applications. Assuming they can bake in better models I'm just as bullish or even moreso on this, considering this opens up edge computing at the extremely low power requirement.

High tok/s is the future IMO.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#119
post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

[deleted]

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#120

Given that MiMo is as cheap as Deepseek ( previous discussion: https://news.ycombinator.com/item?id=48282814 ) multiplying that by 3x for ultra speed is still shockingly cheap.

MiMo and DeepSeek are not cheap. Anthropic and OpenAI are expensive for what they provide.

Energy is likely more abundant in China. I am not sure about compute, but that must be part of reason for such drastic price differences.
Post reply on HN