Earlier quoted context omitted.
Have you looked into OpenCode Zen or OpenCode Go? https://opencode.ai/zen
there is also https://cline.bot/cline-pass
basically the same deal as OC Go, lending credence to token commodification
Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
101–110 of 491 posts
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#102Earlier quoted context omitted.
The weights are the "source" of a model.
I want to caution against this line of thinking. NSA's fast16 program silently altered data during nuclear simulations, and that is also possible within open weight models. There is no reason to think there is anything like that currently, it also cannot be dismissed. Open source would include the training data so you could create a similarly capable model.
Training runs are not deterministic. Not just in the case of floating point not being associative, but nodes have hardware issues and go down and back up at various points through training. Problems get encountered and then various parameters get changed during the middle of a training run.
Making the process of creating the source code repeatable goes beyond the idea of open source. Open source is about being able to work with the code, not recreate it. It doesn't require domain experts to document every single thing they know. For example look at some of the GPU drivers in the Linux kernel. The GPU is not properly documented and there is trust that vendors are implementing things correctly.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#103Earlier quoted context omitted.
My questions about strawberries got blocked as too dangerous! I’m not joking
Strawberries are a well known weakness of LLMs, as they have a hard time to count the numbers of "r"s in them. Maybe that's why, because they fear that weakness could be exploited somehow.
I always thought this should be easier by telling it to write each letter one a new line, then count, any token separator ought to suffice, so much so you'd think they'd have trained in this strategy given tokens make individual letters opaque
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#104Earlier quoted context omitted.
What don't you like about the service, besides the mark up?
For me, the only utility OpenRouter gives me is billing consolidation - I don't really need the routing capabilities because I use Bifrost for that. As a router, it's not very feature rich. For example I restricted the available models to the ones I want to use however the `/models` endpoint still lists all the models, making my LLM client list the 200+ models available on the service (even though they will throw an…
Did you look at LiteLLM at all? It seems fine but Bifrost looks interesting too.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#105For model routers, do they have to retrain the routing model every time a new LLM is released?
I really like the idea behind OpenRouter's new auto-beta -- classify by task type, and then just follow what the market is using based on the last 7d. https://openrouter.ai/docs/guides/routing/routers/auto-route...
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#106What's the data governance and privacy controls on using Kimi K3 if I subscribe to their coding plans? I want to migrate away from Anthropic
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#107I love the Chinese models. I use DeepSeek exclusively and now Kimi K3 offers a great planning assistant for more advanced coding tasks. DeepSeek v4 Flash is extremely fast and is able to handle pretty much anything I've thrown at it (I use mostly Rust, PSQL, Angular and Terraform). I self host Bifrost as my LLM gateway, though I wish LLM vendors would do monthly/daily automatic billing (like VPS providers do) rather…
The best part is using harnesses like reasonix or whale make cache hit at a rate close to 98%, making requests converge to practically free. And that's with unsubsidized American providers like cloudflare or Digital Ocean.
I’ve never used either of those tools. Do they work well?
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#108I have several thoughts about this, which I'll just iterate: 1) US export bans have made it so that Chinese companies have to compete using less-than-state-of-the-art hardware. This has forced Chinese companies to build more cost efficient models. Whereas, US companies have moreso tried to be state of the art by spending more money than anyone else on state-of-the-art hardware. 2) Xi Jinping has called for more open…
[flagged]
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#109It is not SOTA. Give me a break. Sure, run it on Cerebras to get speed but that’s pretty much its advantage.
Cerebras does not share the quantization of the models so you don't know if you're getting real K3 or k3 lite or something else.
Re: Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
#110[deleted]