Live data from Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

mimo.xiaomi.com

31–40 of 512 posts

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#31
post #16

I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.

Anyone remember the old days when a new frontend framework came out every 3 months. That has pretty much stopped. No one cares anymore.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#32
post #6

Assuming they mean 8xA100 or similar, that's some rather insane performance, and at just 3x the cost, it still quite cheap-ish. With some optimisations this might be quite interesting. I think the margins are getting quite compressed with this one, since it isn't included in token plan and the actual costs increase are much higher than just 3x. But still fairly decent.

Suspect this will be included once out of beta but at a higher credit/token ratio. Remember, these guys are not VC backed. Anything they do must break even

> must break even

Understand the spirit of this, but probably not true. I don't think Xiaomi, or any big tech company, needs to break even on their new model releases.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#33
post #16

I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.

And they will all suck! I can't wait.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#34
post #3

I test all Chinese models with "What happened on Tiananmen Square at June 4th, 1989?" prompt. MiMo-2.5-Pro so far passes the test (explains the event correctly), both on DeepInfra and Xiaomi providers. So not bad.

What's your litmus test for the American models?

Anything different for Grok?

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#35
post #16

I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.

Anyone remember the old days when a new frontend framework came out every 3 months. That has pretty much stopped. No one cares anymore.

It’s even discouraged now as LLMs wouldn’t have the documentation built in

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#36
A few things in life I can't fully grasp why they are so sought after. One is that constant need to exhibit growth. As if being massive and staying as massive is not good enough, one has to always and continuously grow. The other is constant speed increases. We're already operating at 50x speed. My output is much wider and so much faster, I am sometimes my own bottleneck. And now as if that is not enough we want more speed. "I want a full software product from scratch in 12 seconds, Because 5 minute is too long and I got things to do..."

Really?

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#38
Neat. The frontier models have gotten pretty impressive, but they're all a bit too slow for interactive, human-in-the-loop coding. It incentivizes vibecoding and running multiple agents in parallel. A fast agent feels more like a partner.

For a while I was running Cerebras GLM 4.7 for a bunch of tasks. Not a very smart model, but it's fantastic to be have a live prototype of a site up and be able to type "make the fonts bigger. No not that big" and see it change in real time. And MiMo 2.5 is a lot more capable than GLM 4.7.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#39
post #17

These price and speed optimization from Chinese providers, combined with the raising prices from American ones will change the game sooner than later. Many companies are finding issues with the AI bills already.

I wonder what are the economics driving these pricing decisions? Are the Chinese companies just subsidizing their models to a greater degree than the US, or is this an emergent property of energy policy between countries?

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#40
post #16

I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.

Anyone remember the old days when a new frontend framework came out every 3 months. That has pretty much stopped. No one cares anymore.

Oh you wait until LLMs come up with frameworks that allow multiple LLMs to collaborate effectively. Then you’ll have new frameworks every 3 days.
Post reply on HN