Earlier quoted context omitted.
I'm still waiting for the day that one of these models interprets the request weird and outputs an SVG of a Pelican case. https://canada.newark.com/productimages/large/en_US/4492516.... In the field I work in, if someone says "Pelican", 99.99% of the time it's going to be an equipment case. We never have reason or need to refer to the actual bird.
Given that a camera case obviously cannot ride a bicycle, this would clearly and indisputably be an incorrect interpretation of the request. I mean, okay, a bird also cannot ride a bicycle, but at least it is alive, has feet, etc.
Kimi K3: Open Frontier Intelligence
591–600 of 1001 posts
Re: Kimi K3: Open Frontier Intelligence
#592> Kimi K3 is Kimi’s most capable model to date, with 2.8 trillion parameters. This puts them on the top of the largest open models list: Kimi K3 2.8T DeepSeek-V4-Pro 1.6T (49B active) Kimi K2.6 ~1T (32B active) GLM-5.2 754B (40B active) DeepSeek-V3.2 685B Mistral Large 3 675B That's one mighty large model! Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.
Moonshot (true to their name?) has always lead in terms of releasing the largest among open weight LLMs.
> Moonshot is going to need the USD 500 million reportedly raised earlier this year to run this model.
Think Moonshot, as a spin-out, can expect backing from its former parent, Alibaba? I don't think they would be particularly worried about finances, if the Kimi K series continues to outperform the Qwen Max series (which seems to be the case; while Kimi is also super popular in China).
Re: Kimi K3: Open Frontier Intelligence
#593Earlier quoted context omitted.
I had a thought a while back: sell large local models burned onto fused compute / ROM chips. Like cartridges for old game consoles. Slot (or probably plug into USB-C) and go. It’s an ASIC with the model wired into it so it’s very low power and fast. I’d buy these. Say $100 for a frontier class model. Maybe more.
Taalas is developing this, but not for Frontier class models. I hope that if we can least get the easy 80% of work done on that sort of hardware, we can greatly reduce the demand for GPUs, HBM and energy to some extent.
Re: Kimi K3: Open Frontier Intelligence
#594Earlier quoted context omitted.
It's like reading Anthropic's obituary.
This is weird and reactionary. Lots of organizations are continuing to refuse to use chinese models due to security and IP concerns. Anthropic/american models aren't going anywhere anytime soon.
One can run open weights in an exclusive TEE'd GPU too, which still comes out cheaper than closed weight LLMs. Ex: https://chutes.ai/pricing
Re: Kimi K3: Open Frontier Intelligence
#595Earlier quoted context omitted.
Umm, Fable only really came out 2 weeks ago, and GPT-5.6 Sol only 1 week ago. Yes, Kimi K3 appears a touch below them both, but above all other models. So I'd say a few weeks behind, not months now...
Frontier labs release frontier models to the public only if there is market pressure to do so. Anthropic is not even hiding that they have been using Mythos internally for months now. I wouldn’t be surprised if OpenAI (so much for “open”) is using GPT-6 internally already. It appears that peasants like us are not going to get access to frontier AI anymore at any price.
Re: Kimi K3: Open Frontier Intelligence
#596Re: Kimi K3: Open Frontier Intelligence
#597Earlier quoted context omitted.
I'm still waiting for the day that one of these models interprets the request weird and outputs an SVG of a Pelican case. https://canada.newark.com/productimages/large/en_US/4492516.... In the field I work in, if someone says "Pelican", 99.99% of the time it's going to be an equipment case. We never have reason or need to refer to the actual bird.
Given that a camera case obviously cannot ride a bicycle, this would clearly and indisputably be an incorrect interpretation of the request. I mean, okay, a bird also cannot ride a bicycle, but at least it is alive, has feet, etc.
Re: Kimi K3: Open Frontier Intelligence
#598So Chinese labs are driving essentially towards commodotized intelligence. Even if its a few months behind the US. Is this a classic 'commoditize my compliment' situation? They want to sell the hardware and infrastructure behind AI and make the software part not the value driver / moat? I can see it. But also even two Chinese labs sinking 100s of millions USD into training isn't exactly commoditization. It's still a…
If there was some grand strategy for all Chinese labs, surely it'd have leaked by now. I think its more likely that: - Companies can still make money from commodities - Chinese labs only have 5-10% the valuation of OpenAI/Anthropic, so massive monopoly profits aren't necessary. Profit expectations for tech companies in China are really low in general, complete opposite of the US. - Open weighting is a great way to ge…
Especially Chinese companies. Just think about all the other industries where Chinese companies dominate by extremely low cost.
Re: Kimi K3: Open Frontier Intelligence
#599My testing prompt for these models is by no means objective or repeatable (like the pelican) but it's a nice test of curiosity: > Impress me with a 1 page html file Result: https://ydaurtg3fdwhq.kimi.page/ Came out looking pretty cool! By contrast, Fable produced a moderately more interesting "live observatory" of the solar system.