Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Kimi K3: Open Frontier Intelligence

kimi.com

Post reply on HN
Print view View original

211–220 of 1001 posts

Re: Kimi K3: Open Frontier Intelligence

#211

Post by XCSme »

I finished benchmarking[0] it, but it was not fun, it only supports (max) reasoning and the model is quite slow. Apart from a few requests timing out, it also has some issues with tool calling/response format schemas (Moonshot rejected tools.function.parameters with anyOf schema).

It also, for some reason failed to generate either of the 2 coding demos (hamster svg and solar system css animation).

Intelligence-wise, it's between GPT-5.6 Terra and GPT-5.6 Sol. It's ~30% better than Kimi K2.6, but a lot slower and more expensive.

[0]: https://aibenchy.com/compare/moonshotai-kimi-k3-max/moonshot...

Re: Kimi K3: Open Frontier Intelligence

#212

Post by XCSme »

XCSme wrote: post #211

I finished benchmarking[0] it, but it was not fun, it only supports (max) reasoning and the model is quite slow. Apart from a few requests timing out, it also has some issues with tool calling/response format schemas (Moonshot rejected tools.function.parameters with anyOf schema). It also, for some reason failed to generate either of the 2 coding demos (hamster svg and solar system css animation). Intelligence-wise,…

Just saw the logs, coding demos failed due to the 5 minute/task timeout. I have increased it and retesting it now.

EDIT: With 10 minutes timeout, the CSS task completed, but the SVG generation task still timed out. Trying again with 30 minutes timeout...

EDIT2: It completed (now in only ~9 minutes). It's one of the best hamsters[0].

[0]: https://aibenchy.com/compare/moonshotai-kimi-k3-max/moonshot...

Re: Kimi K3: Open Frontier Intelligence

#213

Post by [deleted] »

paxys wrote: post #50
ekojs wrote: post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

> its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol Pretty sure ranking “second” to two others means ranking third.

[deleted]

Re: Kimi K3: Open Frontier Intelligence

#214

Post by ignoramous »

antonyt wrote: post #194
paxys wrote: post #50

Earlier quoted context omitted.

> its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol Pretty sure ranking “second” to two others means ranking third.

Charitably, you could read this as "its overall intelligence [is in a class that] ranks second only to [that of]..."

This is actually what's meant but this bikeshed has been built for yak shaving.

Re: Kimi K3: Open Frontier Intelligence

#215

Post by SyneRyder »

sm-silversight wrote: post #195
InsideOutSanta wrote: post #173

On the first try, Kimi K3 just found the source of a bug that Fable 5 hasn't been able to pinpoint in multiple attempts. It's just one anecdote, and I haven't used K3 much yet, but so far it's looking extremely promising.

How do you use kimi for agentic tasks? I'm used to claude code & codex extensions for vs code, but recently switched to codex cli w/ vim keybinds. Does something like that exist for openrouter?

I don't use Codex CLI myself, but you can configure it to point to OpenRouter instead. OpenRouter has some instructions for Codex CLI and Claude Code here (though they mention Claude Code is not guaranteed to work!):

https://openrouter.ai/docs/cookbook/coding-agents/codex-cli

https://openrouter.ai/docs/cookbook/coding-agents/claude-cod...

Re: Kimi K3: Open Frontier Intelligence

#216

Post by zvikara »

dghlsakjg wrote: post #23
Tiberium wrote: post #2

More details: - https://platform.kimi.ai/docs/guide/kimi-k3-quickstart - https://platform.kimi.ai/docs/pricing/chat-k3 1M context, pricing is $3/$15 for 1M tokens (cache $0.3), which is extremely high for a Chinese open-weight model, but if it's truly competitive with most of the current frontier and is only behind Fable/Sol, the pricing is justified. This is 1:1 pricing of Anthropic's Sonnet series (except Sonnet 5…

Tokenizers also matter. Anthropics tokenizers will encode the same piece of text at a way higher token count than OpenAi, for example. That said, Kimi is competing against GLM in my mind, and GLM 5.2 is less than 1/3 the price.

I believe Kimi is spending more on marketing than GLM (a lot of ads lately) so I guess that's part of what the higher price supposed to cover.

Re: Kimi K3: Open Frontier Intelligence

#217

Post by ignoramous »

Aurornis wrote: post #75
ekojs wrote: post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

> > K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600. This is the same benchmark where Sonnet 5 outperforms Opus 4.8 max. Like all model releases, the benc…

Possible, but pay-as-you-go Hy3 / DeepSeek v4 Pro / MiMo v2.5 Pro (from respective vendors) are genuinely good enough as daily drivers, given the costs (especially, low prices for input cache, which usually makes up 70%+ of total input for agentic workflows). I put in $10 in DeepSeek & Xiaomi MiMo, and I've barely used $1 each, in a week of coding work.

Coding Plans by MiniMax ($20/mo for 1.7b tokens) and Z.ai (~$30/week use for $17/mo) are also tremendous value for money.

Re: Kimi K3: Open Frontier Intelligence

#218

Post by adverbly »

ekojs wrote: post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

> Maybe another DeepSeek moment right here.

Surely not... What made DeepSeek disruptive was that the cost was 10X lower.

In this case, the cost is about 2X lower the Sol I think?

At 2X, you're pretty close to the error margins due to token efficiency etc...

I'd say this is "on trend" for open models catching up to frontier labs, but its not a "change in the trend" like DeepSeek was IMO.

Re: Kimi K3: Open Frontier Intelligence

#220

Post by igravious »

sm-silversight wrote: post #195
InsideOutSanta wrote: post #173

On the first try, Kimi K3 just found the source of a bug that Fable 5 hasn't been able to pinpoint in multiple attempts. It's just one anecdote, and I haven't used K3 much yet, but so far it's looking extremely promising.

How do you use kimi for agentic tasks? I'm used to claude code & codex extensions for vs code, but recently switched to codex cli w/ vim keybinds. Does something like that exist for openrouter?

Kimi has Kimi Code :)

kimi-code https://www.kimi.com/code/en

Post reply on HN