Kimi K3: Open Frontier Intelligence

Post by simonw » Thu, Jul 16, 2026, 4:25 PM UTC

ekojs wrote: post #37

> In our evaluations, Kimi K3 delivers frontier-level performance. Among the models tested, its overall intelligence ranks second only to Claude Fable 5 and GPT-5.6 Sol. For the complete benchmark results, see our tech blog. The full model weights of Kimi K3 will be released in the coming days. More details on the architecture, training, and evaluation will be published together with the Kimi K3 technical report. > K…

Post by floam » Thu, Jul 16, 2026, 4:29 PM UTC

simonw wrote: post #137

smallerize wrote: post #132

Earlier quoted context omitted.

How did "Generate an SVG of a pelican riding a bicycle" turn into 95 tokens?

That's a great question. I just tried "hi" through the same OpenRouter API and the input token count for that was 86 - and for "hi there" the count was 87. I think there's an 85 token hidden system prompt of some sort.

   {"messages":[
      {"role": "user",
       "content": "hi"}
   ]}

   {"messages":[
      {"role": "system",
       "content": ""}
      {"role": "user",
       "content": "hi"}
   ]}

   {"messages":[
      {"role": "system",
       "content": "x"}
      {"role": "user",
       "content": "hi"}
   ]}

Post by loolhahalmao » Thu, Jul 16, 2026, 4:31 PM UTC

Post by cosqtanq » Thu, Jul 16, 2026, 4:35 PM UTC

Post by SwellJoe » Thu, Jul 16, 2026, 4:35 PM UTC

wolttam wrote: post #94

m3h wrote: post #86

> Kimi K3 is Kimi’s most capable model to date, with 2.8 trillion parameters. This puts them on the top of the largest open models list: Kimi K3 2.8T DeepSeek-V4-Pro 1.6T (49B active) Kimi K2.6 ~1T (32B active) GLM-5.2 754B (40B active) DeepSeek-V3.2 685B Mistral Large 3 675B That's one mighty large model! Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.

I guess it remains to be seen whether this will be open-weights. We don't even know how many active params at this point.