There is some humor in the fact that china (of all countries) is pioneering possibly the world's most important tech via open source, while we (US) are doing the exact opposite.
[deleted]
Kimi K2.6: Advancing open-source coding
41–50 of 394 posts
Re: Kimi K2.6: Advancing open-source coding
#42There is some humor in the fact that china (of all countries) is pioneering possibly the world's most important tech via open source, while we (US) are doing the exact opposite.
Maybe open source == communism
Good ol' Steve "Developers! Developers! Developers!" Ballmer said so a long time ago. What a visionary!
Re: Kimi K2.6: Advancing open-source coding
#43Earlier quoted context omitted.
While I'm skeptical of any "beats opus" claims (many were said, none turned out to be true), I still think it's insane that we can now run close-to-SotA models locally on ~100k worth of hardware, for a small team, and be 100% sure that the data stays local. Should be a no-brainer for teams that work in areas where privacy matters.
I think this one is only about 600GB VRAM usage, so it could fit on two mac studios with 512GB vram each. That would have costed (albeit no longer available) something like less than 20k.
Yeah, but that's personal use at best, not much agentic anything happening on that hardware. Macs are great for small models at small-medium context lengths, but at > 64k (something very common with agentic usage) it struggles and slows down a lot.
The ~100k hardware is suitable for multi-user, small team usage. That's what you'd use for actual work in reasonable timeframes. For personal use, sure macs could work.
Re: Kimi K2.6: Advancing open-source coding
#44wow - $0.95 input/$4 output. If its anywhere near opus 4.6 that's incredible.
This should erase any doubt that AI Labs are making $$$ on API inference. Kimi 2.5 (which this is based on) is served at $0.44 input / $2 output by a ton of different providers on OpenRouter, 2.6 will certainly be similar. That's about 11X less than Opus for similar smarts.
How does it erase any doubt? You’re implying Chinese things can’t be actually cheaper to produce than American which is laughable
Re: Kimi K2.6: Advancing open-source coding
#45K2.5 was already pretty decent so I would try this. Starting at $15/month: https://www.kimi.com/membership/pricing edit: Note that you can run it yourself with sufficient resources (e.g., companies), or access it from other providers too: https://openrouter.ai/moonshotai/kimi-k2.6/providers
What's the privacy/data security like? I can't find that on that page.
Edit: found it.
> We may use your Content to operate, maintain, improve, and develop the Services, to comply with legal obligations, to enforce our policies, and to ensure security. You may opt out of allowing your Content to be used for model improvement and research purposes by contacting us at membership@moonshot.ai. We will honor your choice in accordance with applicable law.
Section 3 of https://www.kimi.com/user/agreement/modelUse?version=v2
Re: Kimi K2.6: Advancing open-source coding
#46Beats opus 4.6! They missed claiming the frontier by a few days.
It doesn't beat Opus 4.6, no way, don't be fooled by benchmarks.
Re: Kimi K2.6: Advancing open-source coding
#47I've always been surprised Kimi doesn't get more attention than it does. It's always stood out to me in terms of creativity, quality... has been my favorite model for awhile (but I'm far from an authority)
Maybe because it's a bit of like unleashing a chaos monkey on your codebase? I tried it locally (K2.5 72B) and couldn't get anything useful.
Re: Kimi K2.6: Advancing open-source coding
#48I've always been surprised Kimi doesn't get more attention than it does. It's always stood out to me in terms of creativity, quality... has been my favorite model for awhile (but I'm far from an authority)
Maybe because it's a bit of like unleashing a chaos monkey on your codebase? I tried it locally (K2.5 72B) and couldn't get anything useful.
Huh, that's not a thing?
Re: Kimi K2.6: Advancing open-source coding
#49I've always been surprised Kimi doesn't get more attention than it does. It's always stood out to me in terms of creativity, quality... has been my favorite model for awhile (but I'm far from an authority)
It's also one of the few models that seem capable of drawing an SVG clock
Re: Kimi K2.6: Advancing open-source coding
#50K2.5 was already pretty decent so I would try this. Starting at $15/month: https://www.kimi.com/membership/pricing edit: Note that you can run it yourself with sufficient resources (e.g., companies), or access it from other providers too: https://openrouter.ai/moonshotai/kimi-k2.6/providers
What's the privacy/data security like? I can't find that on that page. Edit: found it. > We may use your Content to operate, maintain, improve, and develop the Services, to comply with legal obligations, to enforce our policies, and to ensure security. You may opt out of allowing your Content to be used for model improvement and research purposes by contacting us at membership@moonshot.ai. We will honor your choice i…
You really rely on ToS from Anthropic/OpenAI to know if they use your prompts or not? It's on their servers, why wouldn't they use our data?