Earlier quoted context omitted.
Anthropic services have outages on all days ending in y.
So users in Germany are not affected?
Germany ends in y
Kimi K3-256k
51–60 of 172 posts
Re: Kimi K3-256k
#52A bit of topic. But how likely is it that the US will restrict Chinese open weight models and also force Euro countries to do the same? I think it will be effective within 6 months. The US is having a hard time staying competitive.
It isn't legally possible for them to do this at the EU level. The EU parliament would never vote for it.
For pressure at the country level leading to this kind of thing I think it's very unlikely. Here in Sweden it wouldn't just require a vote in the Swedish parliament and before this there'd have to be förarbeten and you can't just brazenly push things through with insane arguments, Swedish social convention goes against it-- and there's just no way to get it through.
It also might not even be legal. "We aren't at war with China and I'm a communist, and the US LLMs are so aligned with values inimical to my political ideology that this is interference with opinion formation" might be an actual legal argument that the ECHR or CJEU might actually have to accept.
Re: Kimi K3-256k
#53LLMs is quickly became commodities. US AI labs like OpenAI is losing their moat. Hyperscalers and data center owners who can sell cheap token will win
Re: Kimi K3-256k
#54Re: Kimi K3-256k
#55Earlier quoted context omitted.
Since the model is open-weights, you can get from other providers, for example see https://openrouter.ai/moonshotai/kimi-k3#providers
The only downside with third party providers is that you have to trust that the provider have setup and configured it correctly, and is not secretly quantizing it. See Kimi Vendor Verifier.
[deleted]
Re: Kimi K3-256k
#56[flagged]
"256k ought to be enough for anybody"
Re: Kimi K3-256k
#57Since Claude is the first time for me really, really out (TIL against my wished about https://status.claude.com/ ), I am now interested enough to see what else works. But ... when I click pricing, I see "Join a waitlist". Wtf? Are they really that good, so were totally surprised and overwhelmed by the requests, is this a marketing stunt, or do they just don't have the hardware being in china?
It's an extremely popular model hosted by a company affected by hardware export bans. I doubt they'd voluntarily prevent people from subscribing if they didn't absolutely have to to maintain service quality.
I have been using Kimi for months. It did get superslow after the K3 launch, then they blocked signups and normalized the service.
It's not ideal that people can't join but as a user I am happy that they focused on serving existing customers.
Re: Kimi K3-256k
#58Earlier quoted context omitted.
I'm always curious what you guys are working on; every git repo I've run a local model on and stick below <100k to increase speed seems effective enough to scope patches and changes.
I have a couple projects where the background research is easily over 500k without writing any code, after ultracode subagents synthesis.
I think the distinction is when the model decides to read code top to bottom vs when the model chooses to parse code indirectly to save on tokens, there's also AST tooling to let the model see project structure.
Re: Kimi K3-256k
#59i've never had any issues with 256k context. see no reason to bump up to 1m if it comes at a premium.