Another deepseek moment? it seems they have fully caught with fable tier of models, and this was a lot sooner than was expected.
Kimi K3: Open Frontier Intelligence
311–320 of 1001 posts
Re: Kimi K3: Open Frontier Intelligence
#312Earlier quoted context omitted.
It's like reading Anthropic's obituary.
This is weird and reactionary. Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns. Anthropic/american models aren't going anywhere anytime soon.
> Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns
This is such a common omission: the Chinese models are open, you can host them yourself on your premises. So privacy and independence.
Re: Kimi K3: Open Frontier Intelligence
#313The blog post is now online:
https://www.kimi.com/blog/kimi-k3
- The blog post is explicitly saying that the model is open; that language was removed from the previously shared link
- It shows benchmarks
I've been playing around with it for the past few hours, and I think it's an amazing model. I'm not sure I could tell the difference between this and Fable in a blind test. The quota in the $100 Kimi Coding plan seems to roughly align with what I get from the $200 Anthropic plan when I primarily use Fable.
Re: Kimi K3: Open Frontier Intelligence
#314Imagine you're a mid sized company and you can host this model locally. Suddenly there are zero reasons to pay a single red cent to the bloodsucking American AI cartel.
Can you host the model for a lower cost per token than you'd pay Anthropic or OpenAI for a similar level of intelligence? I doubt you're beating their efficiencies of scale.
I dont have estimates on the cost of running models, but I think openai and anthropic are running on subsidized prices. At actual prices it might be worth it in the future.
Re: Kimi K3: Open Frontier Intelligence
#315Why do most LLMs insist on a login, even for a free trial? I entered a question to try it, but as soon as I hit enter it wants my phone number for a login. No thanks.
Free use without registration -> free to anyone and anything -> easy to abuse at scale, with no way to restrict use.
You can limit it a lot to minimize the abuse. In free entrypoint, set token and context limits to be very small. Limit to 2 prompts per IP or something every X hour. That is already a substantial limit where bypassing might not provide much benefits.
Re: Kimi K3: Open Frontier Intelligence
#316Another deepseek moment? it seems they have fully caught with fable tier of models, and this was a lot sooner than was expected.
Yeah, I would have expected Zhipu to ship a Fable-adjacent model by the end of the year, but the jump from Kimi 2.7 (which I think is just barely at the level where it is genuinely helpful for coding) to this is absolutely bonkers. And this is clearly not just benchmaxing; this thing actually works.
If you told me I could only use this and never use Fable or Sol again, I'd shrug and not feel like I'd lost much.
Re: Kimi K3: Open Frontier Intelligence
#317Earlier quoted context omitted.
This is weird and reactionary. Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns. Anthropic/american models aren't going anywhere anytime soon.
Nope, but I think this is maybe the critical mass needed to finally crash the AI hype/datacenter cost problem everyones is talking about. With Oracle being junk before this, more will follow.
I would assume the opposite is true — with an open-weight Fable-class model, doesn't demand for GPUs go up? Plenty of companies can now look at what Anthropic is offering — high per token costs for a very intelligent model — and do the math, and at some point it makes sense to just rent the GPU yourself and run Kimi on it if you get similar intelligence without paying Anthropic's margins (albeit with high upfront capital cost).
This would drive down Anthropic's margins, but drive up demand for datacenter and GPU capacity. It's not that people would be using fewer GPUs, they'd just shift demand from high priced token vendors to direct GPU rental, which benefits datacenter companies while hurting Anthropic.
Re: Kimi K3: Open Frontier Intelligence
#318They're saying kimi3 beat Fable in the AttnRes Kernel Optimization benchmark. What does this benchmark actually mean?
Re: Kimi K3: Open Frontier Intelligence
#319No blog post? Benchmarks?
Blog post here: https://www.kimi.com/blog/kimi-k3
Benchmarks look ok, but they don't mention anything about the issue with the model being extremely slow and verbose.
That being said, it's awesome to have such an open-source model, even if now it's unusable mostly locally, with hardware improvements, in a couple of years, the verbosity/speed wouldn't matter as much as the intelligence.
Re: Kimi K3: Open Frontier Intelligence
#320Earlier quoted context omitted.
Can you host the model for a lower cost per token than you'd pay Anthropic or OpenAI for a similar level of intelligence? I doubt you're beating their efficiencies of scale.
I dont have estimates on the cost of running models, but I think openai and anthropic are running on subsidized prices. At actual prices it might be worth it in the future.
how is this idea still so persistent? The fact people are able to run open models with about the same performance at 1/10th the cost should make it glaringly obvious that Anthropic has massive inference margins at api pricing.