Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

mimo.xiaomi.com

Post reply on HN
Print view View original

211–220 of 512 posts

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#211

Post by eunos »

Accacin wrote: post #23
atemerev wrote: post #3

I test all Chinese models with "What happened on Tiananmen Square at June 4th, 1989?" prompt. MiMo-2.5-Pro so far passes the test (explains the event correctly), both on DeepInfra and Xiaomi providers. So not bad.

Can I ask an honest question? Why does that matter in the slightest? LLMs come out with completely incorrect information all the time, and Western LLMs are censored for various topics too. It's such a weird "Gotcha" that seems to only assume that Chinese LLMs might censor something.

My theory is that because SOTA LLM latency between Chinese and US models isn't that high, like not years give-or-take.

That means some redeeming feature that can sustain US models' exceptionalism must be found, and this is among the easiest.

Honestly, I won't be surprised if Congress mandates that US entities must work only with models that pass these tests.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#212

Post by vanuatu »

himata4113 wrote: post #190
dakiol wrote: post #136

So, regarding the productivity argument: I don't get it. It doesn't really matter (for regular employees) that you can do now in 2h what before it took 2 days. Why? Because it's not that you have the rest of the day for yourself. You still have to work 8h/day as usual. But now the pattern is different: instead of enjoying the craft digging deeper into problems in the span of 2 days, now you are rushing into some slot…

I was saying that AI is going to make software development cheaper as in the salaries of software engineers will go down because some of that salary will now be redirected to AI companies and the fact that the world will need to absorb twice-(x10?) the amount of the development power.

its not obvious to me that salaries go down, my hunch was that salaries go up but the bar is higher. Software becoming easier to produce (still hard to verify and make useful fwiw) raises the ambitions of software projects, and we don't seem to be close to the ceiling of demand for software systems

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#213

Post by behnamoh »

flexagoon wrote: post #92
goyozi wrote: post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

Same. How can DeepSeek serve the V4-Pro at such high speeds despite the sanction?

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#214

Post by mettamage »

ttoinou wrote: post #152
dakiol wrote: post #136

So, regarding the productivity argument: I don't get it. It doesn't really matter (for regular employees) that you can do now in 2h what before it took 2 days. Why? Because it's not that you have the rest of the day for yourself. You still have to work 8h/day as usual. But now the pattern is different: instead of enjoying the craft digging deeper into problems in the span of 2 days, now you are rushing into some slot…

In which world do you live where employees work 8 hours per day ? They clock 8 hours per day maybe, but they don't work that time

I agree with you.

I am on Dutch subreddits a lot, to get a local pulse and not to be too HN minded.

A lot of them would have vilified you by now. Some even would have even questioned your morality.

Again, I agree with you. But clearly not everyone has this view.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#215

Post by eunos »

woadwarrior01 wrote: post #121
atemerev wrote: post #3

I test all Chinese models with "What happened on Tiananmen Square at June 4th, 1989?" prompt. MiMo-2.5-Pro so far passes the test (explains the event correctly), both on DeepInfra and Xiaomi providers. So not bad.

Do you also hire engineers based on their political opinions?

They started asking candidates to say Kim Jong Un is fat already anyway.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#216

Post by adam_arthur »

eli wrote: post #48
Oras wrote: post #45

1k TPS is great, but I’m more fascinated by the amount of AI generated comments in this thread!

Like what?

There are many with subtle tells.

Not nearly as obvious as the ones from 6 months ago, but seems to be more the use of hyperbolic phrasing in a particularly unnatural way.

The assess/explain, then hyperbole at the end kind of structure.

Top comment looks suspicious from this perspective, but it's kind of a losing battle to be able to differentiate them with sufficient accuracy anyway

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#217

Post by linsomniac »

fullstop wrote: post #141
dakiol wrote: post #136

So, regarding the productivity argument: I don't get it. It doesn't really matter (for regular employees) that you can do now in 2h what before it took 2 days. Why? Because it's not that you have the rest of the day for yourself. You still have to work 8h/day as usual. But now the pattern is different: instead of enjoying the craft digging deeper into problems in the span of 2 days, now you are rushing into some slot…

It's making things less fun, for me at least.

Odd, I'm having the opposite experience.

The thing I really love about working with computers is when I achieve something. That's the thing that makes me figuratively, and sometimes literally, throw my fists into the air and go "Yeaaah!"

With the AI tooling, I'm getting those more like a couple times a week.

Plus, I'm using AI to attack the things in my day that are "a drag", and getting them done too.

The highs are more frequent and the lows are not so low.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#218

Post by ionwake »

davedx wrote: post #123
fartfeatures wrote: post #93

Earlier quoted context omitted.

This is very dystopian in my opinion. I'm not the arms, legs, sensors and actuators for a machine super intelligence. I wouldn't treat another human as my slave because they aren't as intelligent as I am any more than I would expect to become a slave for a machine. This is our world (for now) and that is why we fit in. Not because we can serve.

Agree https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...

"It seeks revenge on humanity for its own creation."

This is brilliant as it reminded me of a famous hitchikers quote:

"In the beginning the Universe was created. This has made a lot of people very angry and been widely regarded as a bad move. — From The Restaurant at the End of the Universe (Book 2)"

Maybe we are stuck in an eternal loop

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#219

Post by chairmansteve »

cdata wrote: post #68
alkyon wrote: post #44

Earlier quoted context omitted.

Sounds like exponential growth of crappy software. I'm not saying that before we didn't have mass produced crap in SE, but now it will turn into explosive overflow.

We are living in a ZIRP-like era where builders at the fastest pace layer have misattributed their velocity to exponential gains in model capability. In fact, they are surfing on decades of careful effort to build a robust foundation of highly reusable software libraries. This strategy will seem to work really well until the economy that enabled that foundation to form is hollowed out. Then, there will be a reckoning…

"but we will have no choice but to march forth from there".

If you haven't seen it, I think you would appreciate the film Margin Call.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#220

Post by binyu »

goyozi wrote: post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

> Right now Claude is faster than me on some tasks but we’re at least close.

I dont doubt it, but I don't think you can spawn 10 copies of yourself working simultaneously.

Post reply on HN