Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

mimo.xiaomi.com

Post reply on HN
Print view View original

291–300 of 512 posts

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#291

Post by legulere »

Terretta wrote: post #248
smith7018 wrote: post #184

Earlier quoted context omitted.

I've long believed those numbers were faked by Anthropic/OpenAI to serve as a form of advertisement. The estimates are impossible to verify and their ability to do "2 days of work" in 10 minutes will presumably make the user go "Wow, I just saved SO much time!" Plus, the unnecessary text eats up the users' tokens so it helps the companies on the backend, as well.

> the estimates It doesn't estimate. It generates tokens that read like estimates associated with the context in its training material. What would you expect the generator to output instead?

It generates tokens by estimating what the next token is going to be.

Sure it cannot think like a human, but given it's input, it should give a good statistical answer (approximating not of how long it actually takes, but what a human would say how long it takes).

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#292

Post by [deleted] »

ilaksh wrote: post #207
maxloh wrote: post #8

The generation speed in the demo video is crazy, to say the least, and completely beyond my impressions of LLMs. The Xiaomi team really brought something to the table.

I think these type of demo videos should allow people to get a sense of super intelligence. Because it's very hard to imagine something that is say three times as smart as you -- by definition you wouldn't be able to comprehend it's thoughts -- but this shows clearly what something that can think 100 times faster than you is like.

[deleted]

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#294

Post by Bombthecat »

goyozi wrote: post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

Living on the street or cave lol

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#295

Post by DenisM »

dakiol wrote: post #136

So, regarding the productivity argument: I don't get it. It doesn't really matter (for regular employees) that you can do now in 2h what before it took 2 days. Why? Because it's not that you have the rest of the day for yourself. You still have to work 8h/day as usual. But now the pattern is different: instead of enjoying the craft digging deeper into problems in the span of 2 days, now you are rushing into some slot…

> with the hope of it giving you the right answer with the right prompt.

Consider that our ability to evaluate quality of the output is falling further behind our ability to produce it. The “right answer” is not the most likely outcome.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#296

Post by dd8601fn »

linsomniac wrote: post #217
fullstop wrote: post #141

Earlier quoted context omitted.

It's making things less fun, for me at least.

Odd, I'm having the opposite experience. The thing I really love about working with computers is when I achieve something. That's the thing that makes me figuratively, and sometimes literally, throw my fists into the air and go "Yeaaah!" With the AI tooling, I'm getting those more like a couple times a week. Plus, I'm using AI to attack the things in my day that are "a drag", and getting them done too. The highs are…

I did a deep binge on two or three projects I would never do, and like five small ones that would have consumed months.

It felt like that, kinda, for a bit. Now whenever it does something for me I get nothing. I didn’t do it… the chatbot did. What’s for me to celebrate? How can there be any real pride or satisfaction for a thing that was just handed to me because I asked for it?

If anything it diminishes my satisfaction looking back on previous projects. They’re “a few hours with a chatbot”, now.

The things I had to learn and the informed decisions I had to make? All pointless trivia, now. A child could do it.

The magic and possibilities parts just all wore off after a heavy run, and I don’t know if that’s ever coming back.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#298

Post by dd8601fn »

fullstop wrote: post #276
linsomniac wrote: post #217

Earlier quoted context omitted.

Odd, I'm having the opposite experience. The thing I really love about working with computers is when I achieve something. That's the thing that makes me figuratively, and sometimes literally, throw my fists into the air and go "Yeaaah!" With the AI tooling, I'm getting those more like a couple times a week. Plus, I'm using AI to attack the things in my day that are "a drag", and getting them done too. The highs are…

Oh, sure, I can make things with it. But I have an extraordinarily hard time saying that I made something. It feels like it cheapens the whole thing. Maybe I'm just old, because I remember people saying the same thing about code completion in Visual Studio back in the late 90s. This is so much more than code completion, though.

Exactly how I feel. I didn’t make a damn thing. I essentially asked a chatbot to.

Did I ask for better things with some important concepts pre-rolled? Yeah, of course. But that’s so, so much less interesting than having actually made a thing.

I try to remind myself that the output of my projects have nothing to do with who I am, but the honest truth is they always mattered to me.

Now that’s dead, and it’s never coming back. It ain’t exactly existential dread, but it is something I’ve lost.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#299

Post by _davide_ »

Accacin wrote: post #23
atemerev wrote: post #3

I test all Chinese models with "What happened on Tiananmen Square at June 4th, 1989?" prompt. MiMo-2.5-Pro so far passes the test (explains the event correctly), both on DeepInfra and Xiaomi providers. So not bad.

Can I ask an honest question? Why does that matter in the slightest? LLMs come out with completely incorrect information all the time, and Western LLMs are censored for various topics too. It's such a weird "Gotcha" that seems to only assume that Chinese LLMs might censor something.

>It's such a weird "Gotcha" that seems to only assume that Chinese LLMs might censor something.

We are not assuming anything; it is illegal, and you will get prison time just for talking about it. Yeah, sure, everyone distorts reality, but there is a huge gap between hiding and enforcing. So yeah, having models respond accordingly is unexpected. There are probably multiple variants tuned differently.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#300

Post by KronisLV »

smith7018 wrote: post #184
throwaway67678 wrote: post #170

Earlier quoted context omitted.

Agent mania setting in It's also pretty funny sometimes how it gives weird future roadmap estimates ("part 2 - 3 weeks, part 3 - 2 months", etc.) and when you tell it to actually do those changes it's pretty much done in half an hour

I've long believed those numbers were faked by Anthropic/OpenAI to serve as a form of advertisement. The estimates are impossible to verify and their ability to do "2 days of work" in 10 minutes will presumably make the user go "Wow, I just saved SO much time!" Plus, the unnecessary text eats up the users' tokens so it helps the companies on the backend, as well.

I mean in general I'd rather take slightly inflated estimates than the odd sprint poker stuff where other devs and PMs negotiate hours down and before you know it you're also stuck fixing nitpicky reviewer comments on code that is already good enough and have to send a release at like 7 PM, ofc also without enough tests or even enough manual checks and testing, cause people repeatedly act against their self-interest and try to compress timelines, thinking that that's somehow good for them.

At least with AI that actually does things more quickly, there is a bit more breathing room (introducing AI is easier than changing a given environment).

Aside from that, I wonder how much variety there is in practice: between "Oh yeah, I added that new button while we were in the meeting" and "The new button feature will be ready in Q3 according to the roadmap, once we have sign-off from all the stakeholders."

Post reply on HN