Why SoTA (uppercase “T”) instead of SotA (lowercase “T”) ? “State of [T]he Art” versus “State of [t]he Art”. If not SotA then at least SOTA, which is more accurate.
I suspect typo.
Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
71–80 of 491 posts
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#72A third the cost, open source, and won't refuse every other request because of some vague possible connection to cybersecurity concerns.
From the blog post moonshot refers to it as open source but only mentions releasing the weights.
So far all the Kimi models have open sourced their code, their weights, and published technical reports explaining their training methodology. I expect the Kimi K3 Technical Report will come out July 27 and they usually publish the code and the weights alongside that.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#73Was this an out of sample test of the router or was it trained on these specific use cases/eval suites?
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#74[flagged]
> hyping an open model that isn’t open
Moonshot has committed to release it end of the month.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#75I love the Chinese models. I use DeepSeek exclusively and now Kimi K3 offers a great planning assistant for more advanced coding tasks. DeepSeek v4 Flash is extremely fast and is able to handle pretty much anything I've thrown at it (I use mostly Rust, PSQL, Angular and Terraform). I self host Bifrost as my LLM gateway, though I wish LLM vendors would do monthly/daily automatic billing (like VPS providers do) rather…
The best part is using harnesses like reasonix or whale make cache hit at a rate close to 98%, making requests converge to practically free. And that's with unsubsidized American providers like cloudflare or Digital Ocean.
How can you be hitting cache on what I think are novel LLM prompts …
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#76A third the cost, open source, and won't refuse every other request because of some vague possible connection to cybersecurity concerns.
My questions about strawberries got blocked as too dangerous! I’m not joking
I asked about Tiananmen Square and it said it knew nothing about it. A real life “Doesn’t look like anything to me” moment.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#77Earlier quoted context omitted.
The weights are the "source" of a model.
The weights are the output artifact, the training corpus and system are the source.
Kimi publishes their code and a technical report on their methodology. But I think the weights are still important. It means anyone with the resources could run the same model on their own hardware.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#78Earlier quoted context omitted.
Strawberries are a well known weakness of LLMs, as they have a hard time to count the numbers of "r"s in them. Maybe that's why, because they fear that weakness could be exploited somehow.
Probably need to be taught by someone of Latino origin. Learning to roll them "r"s could help.
2/3rds of all languages use rolled r's
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#79It is not SOTA. Give me a break. Sure, run it on Cerebras to get speed but that’s pretty much its advantage.
Why do you think it's not SOTA?
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#80Very interesting. They test Kimi K3 and Fable on a set of approx 1000 tasks grouped into 5 areas (SWE, Legal, etc). They put a router model in front that predicts whether Kimi or Fable is going to give a better cost for a correct result. (They believe that ultimately such a router model should be continuously trained on your own workloads so it makes the best decisions for you). Their router chose Kimi the majority o…
> Oracle routing is a method for measuring the best theoretical performance by running the task through each model and then picking the cheapest correct option (the cost/performance ceiling).
Their "router" is an oracle reference point where they choose the lower cost model after running both and therefore knowing who passed the test. The cost savings part is only Fireworks theorizing what would happen if an equivalent predicting router exists. That's a big if.