Anybody getting the result that Kimi 3 is more expensive than Opus 5 or Sol on Cursor? Pretty sure Kimi 3 sucked up a good chunk of my ultimate plan in a few prompts. Anyone have any tools or ways to understand per model usage towards cursor subscriptions? I know there are alternatives to cursor just haven’t made the move yet. (Edit spelling)
Kimi K3 Architecture Overview and Notes
61–70 of 125 posts
Re: Kimi K3 Architecture Overview and Notes
#62Re: Kimi K3 Architecture Overview and Notes
#63Re: Kimi K3 Architecture Overview and Notes
#64Anybody getting the result that Kimi 3 is more expensive than Opus 5 or Sol on Cursor? Pretty sure Kimi 3 sucked up a good chunk of my ultimate plan in a few prompts. Anyone have any tools or ways to understand per model usage towards cursor subscriptions? I know there are alternatives to cursor just haven’t made the move yet. (Edit spelling)
Oh no! First time dealing with an American corporation?
Re: Kimi K3 Architecture Overview and Notes
#65So, unlike what leaders of western labs labs would like you to believe (that Kimi is just the result of distillation attacks), they are introducing new and novel approaches.
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the new approaches. So I wouldn't take the new approaches to be much evidence about whether the distillation attacks occurred.
Even Anthropic hasn't claimed "Kimi is largely a byproduct of distillation"
There's been some distillation.
Just like how Elon said in court they distill to make Grok.
Re: Kimi K3 Architecture Overview and Notes
#66Earlier quoted context omitted.
This is so true honestly.
Also Reddit-style humorous replies were frowned upon because they ruin serious discussion and encourage karma chasing as opposed to providing valuable insight.
With all the botting and slop going on right now on HN I'd say these once annoyances are now quite arbitrary. I'm sure it bothered you and maybe one other person at this point in time, but it's pretty damn easy to scroll past it compared to actively reading comments that you half way through realize are just LLMs.
Re: Kimi K3 Architecture Overview and Notes
#67Genuine question: how reproducible / usable / verifiable are these architectures from the published documentation? Are they similar to PDF/DWG/PSD specifications, where the format look like an open spec at first sight until you attempt to implement it and realize the crucial implementation details are undocumented?
It's entirely reproducible from the available documentation (which is why you see vLLM, SGLang, MLX etc all racing to produce optimized implementations).
(As an aside, this is why the "open weights are not open source" thing is a complete misunderstanding. The weights themselves along with the documentation give you enough to fine tune the LLM. You can't rebuild it from scratch, but you can't do this even with the data anyway (because of randomness!))
Re: Kimi K3 Architecture Overview and Notes
#68Just tried K3 out for the first time today and it's a legitimate threat. Temporarily (maybe permanently) using it as my daily driver but it's wild how comparable it is to Opus 4.7/4.8 (what's been my go to for a bit now—wrote a quick post on what I found today [1]). [1] https://graybearding.bearblog.dev/kimi-k3-is-insane/
Agreed. Dropped my $200/mo Claude I was saturating for the $100/mo moonshot sub and have no complaints Plus I can actually see the thinking traces and I’m not getting downgraded/denied by anthropic constsntly…
How much usage do you get out of the $100 Moonshot plan? I haven't heard great things.
Re: Kimi K3 Architecture Overview and Notes
#69Re: Kimi K3 Architecture Overview and Notes
#70Genuine question: how reproducible / usable / verifiable are these architectures from the published documentation? Are they similar to PDF/DWG/PSD specifications, where the format look like an open spec at first sight until you attempt to implement it and realize the crucial implementation details are undocumented?
It's entirely reproducible from the available documentation (which is why you see vLLM, SGLang, MLX etc all racing to produce optimized implementations). (As an aside, this is why the "open weights are not open source" thing is a complete misunderstanding. The weights themselves along with the documentation give you enough to fine tune the LLM. You can't rebuild it from scratch, but you can't do this even with the da…
> open weights are not open source" thing is a complete misunderstanding
> You can't rebuild it from scratch
There's is extremely clear and misunderstanding-free.
Open weights is not open source.