Looks like open models being months behind is a thing of the past. Now more like weeks.
Kimi K3: Open Frontier Intelligence
421–430 of 1001 posts
Re: Kimi K3: Open Frontier Intelligence
#422Is K3 marked as a proprietary model because its weights have not been released yet? Were there indications from Moonshot that K3 would or would not be open weights?
> Kimi K3 is the first open model to reach 2.8 trillion parameters. It marks the latest step in Kimi's sustained push at the scaling frontier: for nine of the past twelve months, Kimi models have set the upper bound of open-model sizes.
Re: Kimi K3: Open Frontier Intelligence
#423> Chip Design > As an early proof of concept, Kimi K3 designed a chip to serve a nano model built on its own architecture. In a single 48-hour autonomous run, K3 built, optimized, and verified the chip using open-source EDA tools on the Nangate 45nm library. Within 4 mm², the chip closes timing at 100 MHz and sustains over 8,700 tokens/s decode throughput in simulation, packing 1.46M standard cells, 0.277 MB of SRAM,…
I had a thought a while back: sell large local models burned onto fused compute / ROM chips. Like cartridges for old game consoles. Slot (or probably plug into USB-C) and go. It’s an ASIC with the model wired into it so it’s very low power and fast. I’d buy these. Say $100 for a frontier class model. Maybe more.
Re: Kimi K3: Open Frontier Intelligence
#424> Chip Design > As an early proof of concept, Kimi K3 designed a chip to serve a nano model built on its own architecture. In a single 48-hour autonomous run, K3 built, optimized, and verified the chip using open-source EDA tools on the Nangate 45nm library. Within 4 mm², the chip closes timing at 100 MHz and sustains over 8,700 tokens/s decode throughput in simulation, packing 1.46M standard cells, 0.277 MB of SRAM,…
I had a thought a while back: sell large local models burned onto fused compute / ROM chips. Like cartridges for old game consoles. Slot (or probably plug into USB-C) and go. It’s an ASIC with the model wired into it so it’s very low power and fast. I’d buy these. Say $100 for a frontier class model. Maybe more.
Re: Kimi K3: Open Frontier Intelligence
#425Just in case you were thinking of signing up directly with Moonshot to use the service, they appear to train even on API use: > We may use Content to provide, maintain, develop, support, and improve the Services, comply with applicable law, enforce our terms and policies, and keep the Services safe and secure. Customer who requires restrictions on the use of Customer Content for training or improving Moonshot AI mode…
Re: Kimi K3: Open Frontier Intelligence
#426Earlier quoted context omitted.
These benchmark numbers are insane. The days when China was 6 months behind are over? How are they doing this with so much less resources than the US??? I have so much respect for the researchers there
What makes you think they have less resources?
Re: Kimi K3: Open Frontier Intelligence
#427Re: Kimi K3: Open Frontier Intelligence
#428Just in case you were thinking of signing up directly with Moonshot to use the service, they appear to train even on API use: > We may use Content to provide, maintain, develop, support, and improve the Services, comply with applicable law, enforce our terms and policies, and keep the Services safe and secure. Customer who requires restrictions on the use of Customer Content for training or improving Moonshot AI mode…
[flagged]
Re: Kimi K3: Open Frontier Intelligence
#429https://artificialanalysis.ai/models/comparisons/kimi-k3-vs-...
https://artificialanalysis.ai/models/comparisons/kimi-k3-vs-...
Re: Kimi K3: Open Frontier Intelligence
#430Is K3 marked as a proprietary model because its weights have not been released yet? Were there indications from Moonshot that K3 would or would not be open weights?
The blog post says it's going to be open, but I don't think the weights have been released yet: > Kimi K3 is the first open model to reach 2.8 trillion parameters. It marks the latest step in Kimi's sustained push at the scaling frontier: for nine of the past twelve months, Kimi models have set the upper bound of open-model sizes. https://www.kimi.com/blog/kimi-k3
Still sensible to mark proprietary for now though.