Live data from Hacker News

Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

kimi.com

111–120 of 251 posts

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#111
post #48

Earlier quoted context omitted.

The other realistic setup is $20k, for a small company that needs a private AI for coding or other internal agentic use with two Mac Studios connected over thunderbolt 5 RMDA.

That won’t realistically work for this model. Even with only ~32B active params, a 1T-scale MoE still needs the full expert set available for fast routing, which means hundreds of GB to TBs of weights resident. Mac Studios don’t share unified memory across machines, Thunderbolt isn’t remotely comparable to NVLink for expert exchange, and bandwidth becomes the bottleneck immediately. You could maybe load fragments exp…

RDMA over Thunderbolt is a thing now.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#112
post #42

One thing caught my eyes is that besides K2.5 model, Moonshot AI also launched Kimi Code ( https://www.kimi.com/code ), evolved from Kimi CLI. It is a terminal coding agent, I've been used it last month with Kimi subscription, it is capable agent with stable harness. GitHub: https://github.com/MoonshotAI/kimi-cli

>Kimi Code CLI is not only a coding agent, but also a shell.

That's cool. It also has a zsh hook, allowing you to switch to agent mode wherever you're.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#113
post #110

Earlier quoted context omitted.

The model absolutely can be run at home. There even is a big community around running large models locally: https://www.reddit.com/r/LocalLLaMA/ The cheapest way is to stream it from a fast SSD, but it will be quite slow (one token every few seconds). The next step up is an old server with lots of RAM and many memory channels with maybe a GPU thrown in for faster prompt processing (low two digits tokens/second). At t…

> The model absolutely can be run at home. There even is a big community around running large models locally IMO 1tln parameters and 32bln active seems like a different scale to what most are talking about when they say localLLMs IMO. Totally agree there will be people messing with this, but the real value in localLLMs is that you can actually use them and get value from them with standard consumer hardware. I don't…

32B active is nothing special, there's local setups that will easily support that. 1T total parameters ultimately requires keeping the bulk of them on SSD. This need not be an issue if there's enough locality in expert choice for any given workload; the "hot" experts will simply be cached in available spare RAM.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#114

Earlier quoted context omitted.

One. Trillion. Even on native int4 that’s… half a terabyte of vram?! Technical awe at this marvel aside that cracks the 50th percentile of HLE, the snarky part of me says there’s only half the danger in giving something away nobody can run at home anyway…

The model absolutely can be run at home. There even is a big community around running large models locally: https://www.reddit.com/r/LocalLLaMA/ The cheapest way is to stream it from a fast SSD, but it will be quite slow (one token every few seconds). The next step up is an old server with lots of RAM and many memory channels with maybe a GPU thrown in for faster prompt processing (low two digits tokens/second). At t…

How do you split the model between multiple GPUs?

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#115
post #80

Earlier quoted context omitted.

What amazes me is why would someone spend millions to train this model and give it away for free. What is the business here?

Chinese state that maybe sees open collaboration as the way to nullify any US lead in the field, concurrently if the next "search-winner" is built upon their model the Chinese worldview that Taiwan belongs to China and Tiamen Square massacre never happened. Also their license says that if you have a big product you need to promote them, remember how Google "gave away" site searche widgets and that was perhaps one of…

> Taiwan belongs to China

So they are on the same page as the UN and US?

The One China policy refers to a United States policy of strategic ambiguity regarding Taiwan.[1] In a 1972 joint communiqué with the PRC, the United States "acknowledges that all Chinese on either side of the Taiwan Strait maintain there is but one China and that Taiwan is a part of China" and "does not challenge that position."

https://en.wikipedia.org/wiki/One_China https://en.wikipedia.org/wiki/Taiwan_and_the_United_Nations

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#117
post #110

Earlier quoted context omitted.

> The model absolutely can be run at home. There even is a big community around running large models locally IMO 1tln parameters and 32bln active seems like a different scale to what most are talking about when they say localLLMs IMO. Totally agree there will be people messing with this, but the real value in localLLMs is that you can actually use them and get value from them with standard consumer hardware. I don't…

32B active is nothing special, there's local setups that will easily support that. 1T total parameters ultimately requires keeping the bulk of them on SSD. This need not be an issue if there's enough locality in expert choice for any given workload; the "hot" experts will simply be cached in available spare RAM.

I never said it was special.

I was trying to correct the record that a lot of people will be using models of this size locally because of the local LLM community.

The most commonly downloaded local LLMs are normally https://huggingface.co/unsloth/models?sort=downloads). The things you're saying, especially when combined together, make it not usable by a lot of people in the local LLM community at the moment.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#118

Congratulations, great work Kimi team. Why is that Claude still at the top in coding, are they heavily focused on training for coding or is it their general training is so good that it performs well in coding? Someone please beat the Opus 4.5 in coding, I want to replace it.

I don't think that kind of difference in benchmarks has any meaning at all. Your agentic coding tool and the task you are working on introduce a lot more "noise" than that small delta.

Also consider they are all overfitting on the benchmark itself so there might be that as well (which can go in either directions)

I consider the top models practically identical for coding applications (just personal experience with heavy use of both GPT5.2 and Opus 4.5).

Excited to see how this model compares in real applications. It's 1/5th of the price of top models!!

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#119
post #42

One thing caught my eyes is that besides K2.5 model, Moonshot AI also launched Kimi Code ( https://www.kimi.com/code ), evolved from Kimi CLI. It is a terminal coding agent, I've been used it last month with Kimi subscription, it is capable agent with stable harness. GitHub: https://github.com/MoonshotAI/kimi-cli

>Kimi Code CLI is not only a coding agent, but also a shell. That's cool. It also has a zsh hook, allowing you to switch to agent mode wherever you're.

It is, Kimi Code CLI supports Zed' Agent Client Protocol (http://agentclientprotocol.com/), so it can acts as an external agent that could run in any ACP-compatible client, eg: Zed, Jetbrain, Toad CLI, Minano Notebook. Also, it supports Agent Skills. Moonshot AI developers are actively update the agent and every active. I really like their CLI.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#120
post #80
post #34

The "Deepseek moment" is just one year ago today! Coincidence or not, let's just marvel for a second over this amount of magic/technology that's being given away for free... and how liberating and different this is than OpenAI and others that were closed to "protect us all".

What amazes me is why would someone spend millions to train this model and give it away for free. What is the business here?

Moonshot’s (Kimi’s owner) investors are Alibaba/Tencent et al. Chinese market is stupidly competitive, and there’s a general attitude of “household name will take it all”. However getting there requires having a WeChat-esque user base, through one way or another. If it’s paid, there’ll be friction and it won’t work. Plus, it undermines a lot of other companies, which is a win for a lot of people.
Post reply on HN