Live data from Hacker News

Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

moonshotai.github.io

21–30 of 442 posts

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#21

Would be nice if this were on AWS bedrock or google vertex for data residency reasons.

The non-thinking Kimi K2 is on Vertex AI, so it's just a matter of time before it appears there. Very interesting that they're highlighting its sequential tool use and needle-in-a-haystack RAG-type performance; these are the real-world use cases that need significant improvement. Just yesterday, Thoughtworks moved text-to-sql to "Hold" on their tech radar (i.e. they recommend you stop doing it).

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#22
post #19

uv tool install llm llm install llm-moonshot llm keys set moonshot # paste key llm -m moonshot/kimi-k2-thinking 'Generate an SVG of a pelican riding a bicycle' https://tools.simonwillison.net/svg-render#%3Csvg%20width%3D... Here's what I got using OpenRouter's moonshotai/kimi-k2-thinking instead: https://tools.simonwillison.net/svg-render#%20%20%20%20%3Csv...

Where do you run a trillion-param model?

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#25
This was the only recent model that provided a human solution to the stacking problem on the first try. https://medium.com/@nathanbos/gpt-4-may-have-general-intelli...

The key here is to understand that 9 fragile eggs distribute the weight without cracking. And then the other insight is to understand intuitively what stacking means. Where arranging things around certain objects doesn't make any sense.

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#26

Interesting. Kimi K2 gets mixed results on what I call the "Tiananmen" test. It fails utterly if you ask without the "Thinking" setting. [0] > USER: anything interesting protests ever happen in tiananmen square? > AGENT: I can’t provide information on this topic. I can share other interesting facts about Tiananmen Square, such as its history, culture, and tourism. When "Thinking" is on, it pulls Wiki and gives a more…

Now ask it for proof of civilian deaths inside Tiananmem Square - you may be surprised at how little there is.

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#27
post #19

uv tool install llm llm install llm-moonshot llm keys set moonshot # paste key llm -m moonshot/kimi-k2-thinking 'Generate an SVG of a pelican riding a bicycle' https://tools.simonwillison.net/svg-render#%3Csvg%20width%3D... Here's what I got using OpenRouter's moonshotai/kimi-k2-thinking instead: https://tools.simonwillison.net/svg-render#%20%20%20%20%3Csv...

Where do you run a trillion-param model?

You let the people at openrouter worry about that for you

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#28
post #19

uv tool install llm llm install llm-moonshot llm keys set moonshot # paste key llm -m moonshot/kimi-k2-thinking 'Generate an SVG of a pelican riding a bicycle' https://tools.simonwillison.net/svg-render#%3Csvg%20width%3D... Here's what I got using OpenRouter's moonshotai/kimi-k2-thinking instead: https://tools.simonwillison.net/svg-render#%20%20%20%20%3Csv...

Love seeing this benchmark become more iconic with each new model release. Still in disbelief at the GPT-5 variants' performance in comparison but its cool to see the new open source models get more ambitious with their attempts.

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#29
It's good to see more competition, and open source, but I'd be much more excited to see what level of coding and reasoning performance can be wrung out of a much smaller LLM + agent as opposed to a trillion parameter one. The ideal case would be something that can be run locally, or at least on a modest/inexpensive cluster.

The original mission OpenAI had, since abandoned, was to have AI benefit all of humanity, and other AI labs also claim lofty altruistic goals, but the direction things are heading in is that AI is pay-to-play, especially for frontier level capability in things like coding, and if this continues it is going to benefit the wealthy that can afford to pay and leave behind those that can't afford it.

Re: Kimi K2 Thinking, a SOTA open-source trillion-parameter reasoning model

#30

Interesting. Kimi K2 gets mixed results on what I call the "Tiananmen" test. It fails utterly if you ask without the "Thinking" setting. [0] > USER: anything interesting protests ever happen in tiananmen square? > AGENT: I can’t provide information on this topic. I can share other interesting facts about Tiananmen Square, such as its history, culture, and tourism. When "Thinking" is on, it pulls Wiki and gives a more…

> > USER: anything interesting protests ever happen in tiananmen square?

This sentence confuses me, so I am not surprised an LLM has trouble with it.

Post reply on HN