Live data from Hacker News

Kimi K3: Open Frontier Intelligence

kimi.com

171–180 of 1001 posts

Re: Kimi K3: Open Frontier Intelligence

#171
post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

Where is this from?

Re: Kimi K3: Open Frontier Intelligence

#174
post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

> > K3 pushes the boundary of end-to-end knowledge work. On the GDPval-AA v2 leaderboard, Kimi K3 scores 1687. The benchmark evaluates AI models on real-world tasks across 44 occupations and 9 major industries; Kimi K3 ranks behind only Claude Fable 5 Max and GPT-5.6 Sol Max, and ahead of Claude Opus 4.8 Max at 1600. This is the same benchmark where Sonnet 5 outperforms Opus 4.8 max. Like all model releases, the benc…

Sonnet 5 does beat Opus 4.8 on several benchmarks. It just costs more and takes longer.

(On several other benchmarks, it costs more, takes longer, and does worse.)

Re: Kimi K3: Open Frontier Intelligence

#175
post #111

Pelican: https://tools.simonwillison.net/markdown-svg-renderer#url=ht... - rendered via the OpenRouter API: https://openrouter.ai/moonshotai/kimi-k3 95 input, 16,658 output = 25 cents! https://www.llm-prices.com/#it=95&ot=16658&ic=3&oc=15 (13,241 of those were reasoning tokens.) I think that's the most expensive pelican I've rendered through a Chinese model so far.

The most whimsical benchmaxxing target :)

Re: Kimi K3: Open Frontier Intelligence

#177
post #111

Pelican: https://tools.simonwillison.net/markdown-svg-renderer#url=ht... - rendered via the OpenRouter API: https://openrouter.ai/moonshotai/kimi-k3 95 input, 16,658 output = 25 cents! https://www.llm-prices.com/#it=95&ot=16658&ic=3&oc=15 (13,241 of those were reasoning tokens.) I think that's the most expensive pelican I've rendered through a Chinese model so far.

I wouldn't be surprised if models were optimizing for rendering SVG pelicans at this point

Re: Kimi K3: Open Frontier Intelligence

#178
post #116
post #74

Earlier quoted context omitted.

No, you can't divide the entire size by the expert count. A lot of weights are constant for all tokens, so total active count is ((2800-(shared)/896)*16 + (shared))

TIL, that makes a lot of sense, and thanks for the correction.

Just to add to that, a Transformer block consists of an attention part followed by a feed forward part. MoE only modifies the feed forward part (which basically contains declarative knowledge getting injected into the residual stream).

Re: Kimi K3: Open Frontier Intelligence

#180
Very interesting to see how Gemini 3.5 Pro stacks up against this new wave of models. Hope they have something similar to a Gemini 3.1 moment soon. Their speciality has always been math and multi modal intelligence and the new models are recently all very coding focused.
Post reply on HN