A third the cost, open source, and won't refuse every other request because of some vague possible connection to cybersecurity concerns.
Or biology or chemistry.
Or weapons manufacturing. It can refuse to answer on a lot of topics.
Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
111–120 of 491 posts
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#112A third the cost, open source, and won't refuse every other request because of some vague possible connection to cybersecurity concerns.
[deleted]
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#113Earlier quoted context omitted.
For me, the only utility OpenRouter gives me is billing consolidation - I don't really need the routing capabilities because I use Bifrost for that. As a router, it's not very feature rich. For example I restricted the available models to the ones I want to use however the `/models` endpoint still lists all the models, making my LLM client list the 200+ models available on the service (even though they will throw an…
Did you look at LiteLLM at all? It seems fine but Bifrost looks interesting too.
Yeah I looked at it, LiteLLM is functionally more mature.
The only reason I didn't go for it is I'm not a fan of Python dependency management, Bifrost is just a single executable that uses nearly no memory and is lightning fast.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#114I love the Chinese models. I use DeepSeek exclusively and now Kimi K3 offers a great planning assistant for more advanced coding tasks. DeepSeek v4 Flash is extremely fast and is able to handle pretty much anything I've thrown at it (I use mostly Rust, PSQL, Angular and Terraform). I self host Bifrost as my LLM gateway, though I wish LLM vendors would do monthly/daily automatic billing (like VPS providers do) rather…
The best part is using harnesses like reasonix or whale make cache hit at a rate close to 98%, making requests converge to practically free. And that's with unsubsidized American providers like cloudflare or Digital Ocean.
In long form tasks, across multiple harnesses (Claude Code, OpenCode, Kimi Code, ZCode) my cache rates are typically 96-99%.
I don’t think that’s particularly out of the ordinary. Do people have different experiences with other harnesses? Which ones?
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#115What's the data governance and privacy controls on using Kimi K3 if I subscribe to their coding plans? I want to migrate away from Anthropic
Need to wait until "western" providers start hosting it.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#116I love the Chinese models. I use DeepSeek exclusively and now Kimi K3 offers a great planning assistant for more advanced coding tasks. DeepSeek v4 Flash is extremely fast and is able to handle pretty much anything I've thrown at it (I use mostly Rust, PSQL, Angular and Terraform). I self host Bifrost as my LLM gateway, though I wish LLM vendors would do monthly/daily automatic billing (like VPS providers do) rather…
[flagged]
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#117Earlier quoted context omitted.
One man's offensive penetration tool is another mans defensive tool. In the recent HuggingFace/OpenAI incident the safety controls stood in the way of the defenders, not the attackers: https://www.thestack.technology/hugging-face-hacked-turned-t...
You're presenting further evidence of lack of effective control over these systems as... a mitigating factor...?
Apparently, the attacker in the Hugging Face case was reported to be an internal OpenAI model trying to break into HF and steal the answers to cybersecurity benchmarks: https://openai.com/index/hugging-face-model-evaluation-secur... It really doesn't matter what restrictions are placed on public use of models if the attacking models are internal models at the AI labs themselves.
So if the AI labs are literally running rogue models breaking into other organizations' servers, then yes, I am OK with those organizations self-hosting Chinese models for defensive use.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#118A third the cost, open source, and won't refuse every other request because of some vague possible connection to cybersecurity concerns.
My questions about strawberries got blocked as too dangerous! I’m not joking
My God! You're practically a terrorist and should be on a watchlist! Who knows what you'll ask next? "Who is the surgeon to the boy?"
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#119Earlier quoted context omitted.
I want to caution against this line of thinking. NSA's fast16 program silently altered data during nuclear simulations, and that is also possible within open weight models. There is no reason to think there is anything like that currently, it also cannot be dismissed. Open source would include the training data so you could create a similarly capable model.
Training runs are not deterministic. Not just in the case of floating point not being associative, but nodes have hardware issues and go down and back up at various points through training. Problems get encountered and then various parameters get changed during the middle of a training run. Making the process of creating the source code repeatable goes beyond the idea of open source. Open source is about being able t…
> Training runs are not deterministic.
I agree which is why I said you could make a similarly capable model.
> Open source is about being able to work with the code, not recreate it.
You can also use a hex editor to modify compiled binaries, but no one would consider that "open source".