Earlier quoted context omitted.
MiMo and DeepSeek are not cheap. Anthropic and OpenAI are expensive for what they provide.
Energy is likely more abundant in China. I am not sure about compute, but that must be part of reason for such drastic price differences.
MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
131–140 of 512 posts
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#132Earlier quoted context omitted.
I wonder what are the economics driving these pricing decisions? Are the Chinese companies just subsidizing their models to a greater degree than the US, or is this an emergent property of energy policy between countries?
Lower cost of labor, lots of under the hood optimizations (e.g. cache hits for DS), many of these companies have existing infra (fewer upfront costs for deployment), etc
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#133Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…
Woah - what’s the prompt and what’s the PR?
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#134Fast AI seems genuinely exciting and somewhat unsettling to me. Right now Claude is faster than me on some tasks but we’re at least close. I have a prompt to clean up a PR that’s been running for 1h now and I expect it to take another few. It’s hard to imagine how the workflow would look like if it was near-instant. On the one hand, it might be easier to focus. Some prompts take so long that I start to multitask and…
I'm using Deepseek-v4-pro as my main model and this is sometimes pretty annoying, I have to do some easy boring task, think "I'll just leave the agent to do it and go take a nap", but it's already done writing the code before I even walk away from the computer
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#135Earlier quoted context omitted.
MiMo and DeepSeek are not cheap. Anthropic and OpenAI are expensive for what they provide.
The Chinese "Neijuan" is real & well reported: https://www.reuters.com/business/autos-transportation/what-i... It is another thing the BigLabs accuse open weight models of benefiting from distillation & other techniques & essentially avoid higher training costs (which typically bleed into bills end users pay for inference). Ex A: https://www.anthropic.com/research/2028-ai-leadership Ex B: https://www.reuters.com/worl…
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#136So, if any, I would say it's worse for us. Obviously, it's the completely opposite situation for corporations and executives: they are loving the AI situation so much!
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#137I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.
I'm not sure. Engineers could still develop software the old way, you know taking months to deliver something like, let's say, Obsidian? Or Ghostty? Taking care of every single line of code, of dependencies, of good architecture. Truly the old way. And if the product is good it will succeed.
it needs to win marketing landscape, hyper-overcrowded by thousands of competitors, slop-gened over weekend.
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#138I may sound like a shill, but exponential growth and all. We are going to get near instant software from prompt, multiple ones and then choose the best one. Discussions about choosing a library with the best syntactic sugar method naming is just as crazy as suggesting we type in assembly.
Anyone remember the old days when a new frontend framework came out every 3 months. That has pretty much stopped. No one cares anymore.
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#139Earlier quoted context omitted.
Sounds like exponential growth of crappy software. I'm not saying that before we didn't have mass produced crap in SE, but now it will turn into explosive overflow.
We are living in a ZIRP-like era where builders at the fastest pace layer have misattributed their velocity to exponential gains in model capability. In fact, they are surfing on decades of careful effort to build a robust foundation of highly reusable software libraries. This strategy will seem to work really well until the economy that enabled that foundation to form is hollowed out. Then, there will be a reckoning…
Re: MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 tokens per second
#140Earlier quoted context omitted.
We fit in for the things that are not artificial. So long as AI lives in server farms, humans will be needed for tasks in the physical world. It's only if we combine AI with robots that things get really dicey.
This is very dystopian in my opinion. I'm not the arms, legs, sensors and actuators for a machine super intelligence. I wouldn't treat another human as my slave because they aren't as intelligent as I am any more than I would expect to become a slave for a machine. This is our world (for now) and that is why we fit in. Not because we can serve.