Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

kimi.com

Post reply on HN
Print view View original

151–160 of 251 posts

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#151

Post by tucnak »

PlatoIsADisease wrote: post #136
simonw wrote: post #50

Earlier quoted context omitted.

Models of this size can usually be run using MLX on a pair of 512GB Mac Studio M3 Ultras, which are about $10,000 each so $20,000 for the pair.

You might want to clarify that this is more of a "Look it technically works" Not a "I actually use this" The difference between waiting 20 minutes to answer the prompt '1+1=' and actually using it for something useful is massive here. I wonder where this idea of running AI on CPU comes from. Was it Apple astroturfing? Was it Apple fanboys? I don't see people wasting time on non-Apple CPUs. (Although, I did do this fo…

Mac studio way is not "AI on CPU," as M2/M4 are complex SoC, that includes a GPU with unified memory access.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#152

Post by mohsen1 »

Reubend wrote: post #13

I've read several people say that Kimi K2 has a better "emotional intelligence" than other models. I'll be interested to see whether K2.5 continues or even improves on that.

I'll test it out on mafia-arena.com once it is available on Open Router

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#153

Post by esafak »

vinhnx wrote: post #42

One thing caught my eyes is that besides K2.5 model, Moonshot AI also launched Kimi Code ( https://www.kimi.com/code ), evolved from Kimi CLI. It is a terminal coding agent, I've been used it last month with Kimi subscription, it is capable agent with stable harness. GitHub: https://github.com/MoonshotAI/kimi-cli

Does it support the swarm feature? Does Opencode?

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#155

Post by mholm »

PlatoIsADisease wrote: post #136
simonw wrote: post #50

Earlier quoted context omitted.

Models of this size can usually be run using MLX on a pair of 512GB Mac Studio M3 Ultras, which are about $10,000 each so $20,000 for the pair.

You might want to clarify that this is more of a "Look it technically works" Not a "I actually use this" The difference between waiting 20 minutes to answer the prompt '1+1=' and actually using it for something useful is massive here. I wonder where this idea of running AI on CPU comes from. Was it Apple astroturfing? Was it Apple fanboys? I don't see people wasting time on non-Apple CPUs. (Although, I did do this fo…

The reason Macs get recommended is the unified memory, which is usable as VRAM for the GPU. People are similarly using the AMD Strix Halo for AI which also has a similar memory architecture. Time to first token for something like '1+1=' would be seconds, and then you'd be getting ~20 tokens per second, which is absolutely plenty fast for regular use. Token/s slows down at the higher end of context, but it's absolutely still practical for a lot of usecases. Though I agree that agentic coding, especially over large projects, would likely get too slow to be practical.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#156

Post by Alifatisk »

mohsen1 wrote: post #154
Alifatisk wrote: post #96

Earlier quoted context omitted.

If you bargain with their bot Kimmmmy (not joking), you can even get lower pricing.

tell me more...

Go to kimi chat, there will come up multiple suggestions of use cases. One of them will be the bargain robot. If you download their mobile app, the challenge to bargain will probably popup too!

Depending on how well you bargain with the robot, you can go as low as 0,99$ (difficult). Either way, their moderate plan doesn’t have to be 20$. The agent wants a good reason for why it should lower the price for you.

Here’s the direct link to Kimmmmy:

https://www.kimi.com/kimiplus/sale

I’ll send an invite link too if you don’t mind:

https://www.kimi.com/kimiplus/sale?activity_enter_method=h5_...

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#157

Post by tempoponet »

esafak wrote: post #143
PlatoIsADisease wrote: post #130

Earlier quoted context omitted.

>The model absolutely can be run at home. There is a huge difference between "look I got it to answer the prompt: '1+1='" and actually using it for anything of value. I remember early on people bought Macs (or some marketing team was shoveling it), and proposing people could reasonably run the 70B+ models on it. They were talking about 'look it gave an answer', not 'look this is useful'. While it was a bit obvious th…

Hear, hear. Even if the model fits, a few tokens per second make no sense. Time is money too.

Maybe for a coding agent, but a daily/weekly report on sensitive info?

If it were 2016 and this technology existed but only in 1 t/s, every company would find a way to extract the most leverage out of it.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#158

Post by zozbot234 »

mholm wrote: post #155
PlatoIsADisease wrote: post #136

Earlier quoted context omitted.

You might want to clarify that this is more of a "Look it technically works" Not a "I actually use this" The difference between waiting 20 minutes to answer the prompt '1+1=' and actually using it for something useful is massive here. I wonder where this idea of running AI on CPU comes from. Was it Apple astroturfing? Was it Apple fanboys? I don't see people wasting time on non-Apple CPUs. (Although, I did do this fo…

The reason Macs get recommended is the unified memory, which is usable as VRAM for the GPU. People are similarly using the AMD Strix Halo for AI which also has a similar memory architecture. Time to first token for something like '1+1=' would be seconds, and then you'd be getting ~20 tokens per second, which is absolutely plenty fast for regular use. Token/s slows down at the higher end of context, but it's absolutel…

Not too slow if you just let it run overnight/in the background. But the biggest draw would be no rate limits whatsoever compared to the big proprietary APIs, especially Claude's. No risk of sudden rugpulls either, and the model will have very consistent performance.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#159

Post by pqtyw »

dev_l1x_be wrote: post #115
whizzter wrote: post #92

Earlier quoted context omitted.

Chinese state that maybe sees open collaboration as the way to nullify any US lead in the field, concurrently if the next "search-winner" is built upon their model the Chinese worldview that Taiwan belongs to China and Tiamen Square massacre never happened. Also their license says that if you have a big product you need to promote them, remember how Google "gave away" site searche widgets and that was perhaps one of…

> Taiwan belongs to China So they are on the same page as the UN and US? The One China policy refers to a United States policy of strategic ambiguity regarding Taiwan.[1] In a 1972 joint communiqué with the PRC, the United States "acknowledges that all Chinese on either side of the Taiwan Strait maintain there is but one China and that Taiwan is a part of China" and "does not challenge that position." https://en.wiki…

Existence of an independent and effectively sovereign state on the island of Taiwan (however one calls it) is a fact. Whatever doublespeak governments of other countries or international organizations engage in due to political reasons does not change that.

Re: Kimi Released Kimi K2.5, Open-Source Visual SOTA-Agentic Model

#160

Post by zozbot234 »

WhitneyLand wrote: post #129
johndough wrote: post #81

Earlier quoted context omitted.

The model absolutely can be run at home. There even is a big community around running large models locally: https://www.reddit.com/r/LocalLLaMA/ The cheapest way is to stream it from a fast SSD, but it will be quite slow (one token every few seconds). The next step up is an old server with lots of RAM and many memory channels with maybe a GPU thrown in for faster prompt processing (low two digits tokens/second). At t…

Its often pointed out in the first sentence of a comment how a model can be run at home, then (maybe) towards the end of the comment it’s mentioned how it’s quantized. Back when 4k movies needed expensive hardware, no one was saying they could play 4k on a home system, then later mentioning they actually scaled down the resolution to make it possible. The degree of quality loss is not often characterized. Which makes…

> ...Back when 4k movies needed expensive hardware, no one was saying they could play 4k on a home system, then later mentioning they actually scaled down the resolution to make it possible. ...

int4 quantization is the original release in this case; it's not been quantized after the fact. It's a bit of a nuisance when running on hardware that doesn't natively support the format (might waste some fraction of memory throughput on padding, specifically on NPU hw that can't do the unpacking on its own) but no one here is reducing quality to make the model fit.

Post reply on HN