Open source" lol
It's open-weight. As usual, you don't get the dataset, training scripts, etc.
Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
61–70 of 194 posts
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#62I tried Kimi on a few coding problems that Claude was spinning on. It’s good. It’s huge, way too big to be a “local” model — I think you need something like 16 H200s to run it - but it has a slightly different vibe than some of the other models. I liked it. It would definitely be useful in ensemble use cases at the very least.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#63"Open source" lol Open-weight. As usual, you don't get the dataset, training scripts, etc.
Wont happen under the current copyright regime, it is impossible to train SOTA without copyrighted text, how do you propose distributing that?
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#64I tried Kimi on a few coding problems that Claude was spinning on. It’s good. It’s huge, way too big to be a “local” model — I think you need something like 16 H200s to run it - but it has a slightly different vibe than some of the other models. I liked it. It would definitely be useful in ensemble use cases at the very least.
Reasonable speeds are possible with 4bit quants on 2 512GB Mac Studios (MLX TB4 Ring - see https://x.com/awnihannun/status/1943723599971443134) or even a single socket Epyc system with >1TB of RAM (about the same real world memory throughput as the M Ultra). So $20k-ish to play with it.
For real-world speeds though yeah, you'd need serious hardware. This is more of a "deploy your own stamp" model, less a "local" model.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#65I like new, solid non-reasoning models that push the frontier. These still have nice use cases (basically anything where logic puzzles or STEM subjects don't apply) where you don't want to spend cash on reasoning tokens.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#66Earlier quoted context omitted.
With 32B active parameters it would be ridiculously slow at generation.
DDR3 workstation here - R1 generates at 1 token per second. In practice, this means that for complex queries, the speed of replying is closer to an email response than a chat message, but this is acceptable to me for confidential queries or queries where I need the model to be steerable. I can always hit the R1 API from a provider instead, if I want to. Given that R1 uses 37B active parameters (compared to 32B for K2…
That's pretty good. Are you running the real 600B+ parameter R1, or a distill, though?
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#67Pelican on a bicycle result: https://simonwillison.net/2025/Jul/11/kimi-k2/
That's perhaps the best one I've seen yet! For an open weight model, this performance is of course particularly remarkable and impactful.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#68If I had to guess, the OpenAI open-source model got delayed because Kimi K2 stole their thunder and beat their numbers.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#69If I had to guess, the OpenAI open-source model got delayed because Kimi K2 stole their thunder and beat their numbers.
Re: Kimi K2 is a state-of-the-art mixture-of-experts (MoE) language model
#70"Open source" lol Open-weight. As usual, you don't get the dataset, training scripts, etc.
It's not even open-weight. It's weight-available. It uses a "modified MIT license":
Modified MIT License
Copyright (c) 2025 Moonshot AI
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the “Software”), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
Our only modification part is that, if the Software (or any derivative works
thereof) is used for any of your commercial products or services that have
more than 100 million monthly active users, or more than 20 million US dollars
(or equivalent in other currencies) in monthly revenue, you shall prominently
display "Kimi K2" on the user interface of such product or service.