Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kimi K2.5 Technical Report [pdf]

github.com

Post reply on HN
Print view View original

81–90 of 146 posts

Re: Kimi K2.5 Technical Report [pdf]

#81

Post by observationist »

armcat wrote: post #5
zeroxfe wrote: post #2

I've been using this model (as a coding agent) for the past few days, and it's the first time I've felt that an open source model really competes with the big labs. So far it's been able to handle most things I've thrown at it. I'm almost hesitant to say that this is as good as Opus.

Out of curiosity, what kind of specs do you have (GPU / RAM)? I saw the requirements and it's a beyond my budget so I am "stuck" with smaller Qwen coders.

API costs on these big models over private hosts tend to be a lot less than API calls to the big 4 American platforms. You definitely get more bang for your buck.

Re: Kimi K2.5 Technical Report [pdf]

#82

Post by oxqbldpxo »

This Kimi K2 is so far the best. Gemini is also great, but google is stock in the academic bias of Stanford and MIT and can't think outside the box. China definitely ahead on Ai. Wish somehow someone here in the US, would think different.

Re: Kimi K2.5 Technical Report [pdf]

#83

Post by unleaded »

Seems that K2.5 has lost a lot of the personality from K2 unfortunately, talks in more ChatGPT/Gemini/C-3PO style now. It's not explictly bad, I'm sure most people won't care but it was something that made it unique so it's a shame to see it go.

examples to illustrate

https://www.kimi.com/share/19c115d6-6402-87d5-8000-000062fec... (K2.5)

https://www.kimi.com/share/19c11615-8a92-89cb-8000-000063ee6... (K2)

Re: Kimi K2.5 Technical Report [pdf]

#84

Post by dfsegoat »

oxqbldpxo wrote: post #82

This Kimi K2 is so far the best. Gemini is also great, but google is stock in the academic bias of Stanford and MIT and can't think outside the box. China definitely ahead on Ai. Wish somehow someone here in the US, would think different.

> but google is stock in the academic bias of Stanford and MIT and can't think outside the box

Can you clarify what you mean? I am not sure I follow.

Re: Kimi K2.5 Technical Report [pdf]

#85

Post by JumpCrisscross »

thesurlydev wrote: post #3
zeroxfe wrote: post #2

I've been using this model (as a coding agent) for the past few days, and it's the first time I've felt that an open source model really competes with the big labs. So far it's been able to handle most things I've thrown at it. I'm almost hesitant to say that this is as good as Opus.

Can you share how you're running it?

> Can you share how you're running it?

Not OP, but I've been running it through Kagi [1]. Their AI offering is probably the best-kept secret in the market.

[1] https://help.kagi.com/kagi/ai/assistant.html

Re: Kimi K2.5 Technical Report [pdf]

#86

Post by JSR_FDED »

dfsegoat wrote: post #84
oxqbldpxo wrote: post #82

This Kimi K2 is so far the best. Gemini is also great, but google is stock in the academic bias of Stanford and MIT and can't think outside the box. China definitely ahead on Ai. Wish somehow someone here in the US, would think different.

> but google is stock in the academic bias of Stanford and MIT and can't think outside the box Can you clarify what you mean? I am not sure I follow.

s/stock/stuck/

Re: Kimi K2.5 Technical Report [pdf]

#87

Post by [deleted] »

InsideOutSanta wrote: post #34
BeetleB wrote: post #18

Earlier quoted context omitted.

Just curious - how does it compare to GLM 4.7? Ever since they gave the $28/year deal, I've been using it for personal projects and am very happy with it (via opencode). https://z.ai/subscribe

There's no comparison. GLM 4.7 is fine and reasonably competent at writing code, but K2.5 is right up there with something like Sonnet 4.5. it's the first time I can use an open-source model and not immediately tell the difference between it and top-end models from Anthropic and OpenAI.

[deleted]

Re: Kimi K2.5 Technical Report [pdf]

#88

Post by greenavocado »

hedgehog wrote: post #67
johndough wrote: post #55

Earlier quoted context omitted.

You can run it on consumer grade hardware right now, but it will be rather slow. NVMe SSDs these days have a read speed of 7 GB/s (EDIT: or even faster than that! Thank you @hedgehog for the update), so it will give you one token roughly every three seconds while crunching through the 32 billion active parameters, which are natively quantized to 4 bit each. If you want to run it faster, you have to spend more money.…

High end consumer SSDs can do closer to 15 GB/s, though only with PCI-e gen 5. On a motherboard with two m.2 slots that's potentially around 30GB/s from disk. Edit: How fast everything is depends on how much data needs to get loaded from disk which is not always everything on MoE models.

Would RAID zero help here?

Re: Kimi K2.5 Technical Report [pdf]

#89

Post by rubslopes »

zeroxfe wrote: post #2

I've been using this model (as a coding agent) for the past few days, and it's the first time I've felt that an open source model really competes with the big labs. So far it's been able to handle most things I've thrown at it. I'm almost hesitant to say that this is as good as Opus.

Also my experience. I've been going back and forth between Opus and Kimi for the last few days, and, at least for my CRUD webapps, I would say they are both on the same level.

Re: Kimi K2.5 Technical Report [pdf]

#90

Post by logicprog »

unleaded wrote: post #83

Seems that K2.5 has lost a lot of the personality from K2 unfortunately, talks in more ChatGPT/Gemini/C-3PO style now. It's not explictly bad, I'm sure most people won't care but it was something that made it unique so it's a shame to see it go. examples to illustrate https://www.kimi.com/share/19c115d6-6402-87d5-8000-000062fec... (K2.5) https://www.kimi.com/share/19c11615-8a92-89cb-8000-000063ee6... (K2)

I agree. K2 was blunt, straightforward, pretty... rational? K2.5 has a much stronger slop vibe.
Post reply on HN