Earlier quoted context omitted.
The other realistic setup is $20k, for a small company that needs a private AI for coding or other internal agentic use with two Mac Studios connected over thunderbolt 5 RMDA.
That won’t realistically work for this model. Even with only ~32B active params, a 1T-scale MoE still needs the full expert set available for fast routing, which means hundreds of GB to TBs of weights resident. Mac Studios don’t share unified memory across machines, Thunderbolt isn’t remotely comparable to NVLink for expert exchange, and bandwidth becomes the bottleneck immediately. You could maybe load fragments exp…
Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
111–120 of 251 posts
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#112One thing caught my eyes is that besides K2.5 model, Moonshot AI also launched Kimi Code ( https://www.kimi.com/code ), evolved from Kimi CLI. It is a terminal coding agent, I've been used it last month with Kimi subscription, it is capable agent with stable harness. GitHub: https://github.com/MoonshotAI/kimi-cli
That's cool. It also has a zsh hook, allowing you to switch to agent mode wherever you're.
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#113Earlier quoted context omitted.
The model absolutely can be run at home. There even is a big community around running large models locally: https://www.reddit.com/r/LocalLLaMA/ The cheapest way is to stream it from a fast SSD, but it will be quite slow (one token every few seconds). The next step up is an old server with lots of RAM and many memory channels with maybe a GPU thrown in for faster prompt processing (low two digits tokens/second). At t…
> The model absolutely can be run at home. There even is a big community around running large models locally IMO 1tln parameters and 32bln active seems like a different scale to what most are talking about when they say localLLMs IMO. Totally agree there will be people messing with this, but the real value in localLLMs is that you can actually use them and get value from them with standard consumer hardware. I don't…
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#114Earlier quoted context omitted.
One. Trillion. Even on native int4 that’s… half a terabyte of vram?! Technical awe at this marvel aside that cracks the 50th percentile of HLE, the snarky part of me says there’s only half the danger in giving something away nobody can run at home anyway…
The model absolutely can be run at home. There even is a big community around running large models locally: https://www.reddit.com/r/LocalLLaMA/ The cheapest way is to stream it from a fast SSD, but it will be quite slow (one token every few seconds). The next step up is an old server with lots of RAM and many memory channels with maybe a GPU thrown in for faster prompt processing (low two digits tokens/second). At t…
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#115Earlier quoted context omitted.
What amazes me is why would someone spend millions to train this model and give it away for free. What is the business here?
Chinese state that maybe sees open collaboration as the way to nullify any US lead in the field, concurrently if the next "search-winner" is built upon their model the Chinese worldview that Taiwan belongs to China and Tiamen Square massacre never happened. Also their license says that if you have a big product you need to promote them, remember how Google "gave away" site searche widgets and that was perhaps one of…
So they are on the same page as the UN and US?
The One China policy refers to a United States policy of strategic ambiguity regarding Taiwan.[1] In a 1972 joint communiqué with the PRC, the United States "acknowledges that all Chinese on either side of the Taiwan Strait maintain there is but one China and that Taiwan is a part of China" and "does not challenge that position."
https://en.wikipedia.org/wiki/One_China https://en.wikipedia.org/wiki/Taiwan_and_the_United_Nations
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#116Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#117Earlier quoted context omitted.
> The model absolutely can be run at home. There even is a big community around running large models locally IMO 1tln parameters and 32bln active seems like a different scale to what most are talking about when they say localLLMs IMO. Totally agree there will be people messing with this, but the real value in localLLMs is that you can actually use them and get value from them with standard consumer hardware. I don't…
32B active is nothing special, there's local setups that will easily support that. 1T total parameters ultimately requires keeping the bulk of them on SSD. This need not be an issue if there's enough locality in expert choice for any given workload; the "hot" experts will simply be cached in available spare RAM.
I was trying to correct the record that a lot of people will be using models of this size locally because of the local LLM community.
The most commonly downloaded local LLMs are normally https://huggingface.co/unsloth/models?sort=downloads). The things you're saying, especially when combined together, make it not usable by a lot of people in the local LLM community at the moment.
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#118Congratulations, great work Kimi team. Why is that Claude still at the top in coding, are they heavily focused on training for coding or is it their general training is so good that it performs well in coding? Someone please beat the Opus 4.5 in coding, I want to replace it.
Also consider they are all overfitting on the benchmark itself so there might be that as well (which can go in either directions)
I consider the top models practically identical for coding applications (just personal experience with heavy use of both GPT5.2 and Opus 4.5).
Excited to see how this model compares in real applications. It's 1/5th of the price of top models!!
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#119One thing caught my eyes is that besides K2.5 model, Moonshot AI also launched Kimi Code ( https://www.kimi.com/code ), evolved from Kimi CLI. It is a terminal coding agent, I've been used it last month with Kimi subscription, it is capable agent with stable harness. GitHub: https://github.com/MoonshotAI/kimi-cli
>Kimi Code CLI is not only a coding agent, but also a shell. That's cool. It also has a zsh hook, allowing you to switch to agent mode wherever you're.
Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model
#120The "Deepseek moment" is just one year ago today! Coincidence or not, let's just marvel for a second over this amount of magic/technology that's being given away for free... and how liberating and different this is than OpenAI and others that were closed to "protect us all".
What amazes me is why would someone spend millions to train this model and give it away for free. What is the business here?