Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

mimo.xiaomi.com

Post reply on HN
Print view View original

331–340 of 512 posts

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#331

Post by nativeit »

cicko wrote: post #140
fartfeatures wrote: post #93

Earlier quoted context omitted.

This is very dystopian in my opinion. I'm not the arms, legs, sensors and actuators for a machine super intelligence. I wouldn't treat another human as my slave because they aren't as intelligent as I am any more than I would expect to become a slave for a machine. This is our world (for now) and that is why we fit in. Not because we can serve.

"This is our world" sounds a bit exclusive towards other living and sentient beings on this planet.

It depends on what’s included in “our”.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#332

Post by OtomotO »

goyozi wrote: post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

> That’s a game changer and I don’t even know where we fit in.

Doing non trivial work.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#333

Post by [deleted] »

chrismustcode wrote: post #86
miroljub wrote: post #61

Earlier quoted context omitted.

MiMo and DeepSeek are not cheap. Anthropic and OpenAI are expensive for what they provide.

You don't consider Input $0.435 Output $0.87 cache read $0.003625 per million tokens for near frontier intelligence cheap?

[deleted]

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#334

Post by nl »

Terretta wrote: post #248
smith7018 wrote: post #184

Earlier quoted context omitted.

I've long believed those numbers were faked by Anthropic/OpenAI to serve as a form of advertisement. The estimates are impossible to verify and their ability to do "2 days of work" in 10 minutes will presumably make the user go "Wow, I just saved SO much time!" Plus, the unnecessary text eats up the users' tokens so it helps the companies on the backend, as well.

> the estimates It doesn't estimate. It generates tokens that read like estimates associated with the context in its training material. What would you expect the generator to output instead?

Actually in this case they possibly are estimates.

It's been known for some years[1] that LLMs do regression in-context. Frontier models have been trained against many, many issue text that include task break downs and estimates.

[1] https://arxiv.org/html/2409.04318v1

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#335

Post by pmxi »

chrismustcode wrote: post #86
miroljub wrote: post #61

Earlier quoted context omitted.

MiMo and DeepSeek are not cheap. Anthropic and OpenAI are expensive for what they provide.

You don't consider Input $0.435 Output $0.87 cache read $0.003625 per million tokens for near frontier intelligence cheap?

It’s near the frontier meaning it’s the best intelligence for the price.

It’s not even close to frontier meaning it’s the best intelligence.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#337

Post by nl »

irthomasthomas wrote: post #287
ghshephard wrote: post #271

Earlier quoted context omitted.

I think people are continuing to view these systems as pure LLMs - when that ship sailed 6+ months ago. Between being able to review memory, using agent harnesses and sub agents and skills to go out and discover information - modern systems (Codex, Claude Code, Cursor) - use LLMs - but the LLM is only a small component of it. Compare what you get from sending a request to a chatbot like ChatGPT - to what you can from…

No one is bitter lesson pilled anymore. Everyone is pivoting to neurosymbolic systems. It looks like Gary Marcus was right.

> No one is bitter lesson pilled anymore.

Will the 10T parameter Mythos model be released this month or next month?

They better soon because it is generally accepted that one of the reasons GPT 5.5 is better at hard tasks than Opus is because of its parameter size - and that Opus 4.8 remains competitive only be scaling test-time compute (see how many more tokens it uses than GPT 5.5)

https://www.reddit.com/r/LLM/comments/1sz8bjz/parameter_esti...

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#338

Post by HDBaseT »

miroljub wrote: post #256
chrismustcode wrote: post #86

Earlier quoted context omitted.

You don't consider Input $0.435 Output $0.87 cache read $0.003625 per million tokens for near frontier intelligence cheap?

No. They still have enormous profit margins on inference with these prices.

I highly doubt there is any margin on those inference pricing.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#339

Post by andai »

flexagoon wrote: post #92
goyozi wrote: post #58

Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

With Flash it's basically instant for smaller tasks, yeah.

Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second

#340

Post by andai »

throwaway67678 wrote: post #170
flexagoon wrote: post #92

Earlier quoted context omitted.

I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer

Agent mania setting in It's also pretty funny sometimes how it gives weird future roadmap estimates ("part 2 - 3 weeks, part 3 - 2 months", etc.) and when you tell it to actually do those changes it's pretty much done in half an hour

I heard an anecdote. Guy spent several days trying to convince his AI agent to build a feature. Kept saying it was crazy complicated, would take weeks.

Finally he convinced it to try. It one shotted it in 30 seconds.

Turns out the agents' idea of what is hard and easy also comes from Common Crawl.

Post reply on HN