Live data from Hacker News

Kimi K2.6: Advancing open-source coding

kimi.com

381–390 of 394 posts

Re: Kimi K2.6: Advancing open-source coding

#381

Earlier quoted context omitted.

Bias and censorship are not identical. The subject of this thread is censorship, not bias. Besides, why do you want a model to produce propaganda? Surely you have better things to do.

"Surely you have better things to do." I certainly gave the hypothetical reader too much credit.

This entire argument isn't even worth engaging with. There's always that one guy in every thread who wants to die on this hill. The problem they claim is important can be resolved, because we have the weights. I can't do fuck all about whatever implicit bias OpenAI or Anthropic have.

Re: Kimi K2.6: Advancing open-source coding

#382

Earlier quoted context omitted.

The three American labs don't release big open source models. Except gpt-oss, i guess. It's an absolute shame how far the us has fallen in this space.

Anthropic doesn't, but Google and OAI both release open source models. Just not 1T parameter ones.

That sentence is giving OpenAI way more credit than they are due.

They released a single open model after being goaded by the community because everyone except "Open"AI were multiple generations into open releases.

We haven't heard a word since, I wouldn't be surprised if it takes them another 6 years to release their next one.

Re: Kimi K2.6: Advancing open-source coding

#383
post #129

Earlier quoted context omitted.

I wonder if there's a strategy behind all of this on China's side. I know the CCP uses a direct hand in many affairs in China, but is there an actual coordinated effort to compete with, or sabotage the West?

Seems obvious to me that China would not want to give the AI market to US companies. You don't even need anything like an attempt to "sabotage the West". If I were them (the companies or the government) I'd be very hesitant to let US companies dominate this space. Especially companies that close to the current US administration.

Exactly, more large nations should be establishing or fostering their own labs. Outside of the Chinese and US companies there's really only Mistral.

Re: Kimi K2.6: Advancing open-source coding

#384

Earlier quoted context omitted.

At this point drawing these Pelicans must be in the training data sets.

not if I can help it! https://github.com/scosman/pelicans_riding_bicycles

I have phds both in pelicans and bicycles and may professionally attest that are some fine specimens of pelicans riding bicycles.

Re: Kimi K2.6: Advancing open-source coding

#385

Earlier quoted context omitted.

I'm looking at your table now - is there a reason why you don't include cost? If Opus 4.7 is the winner but costs e.g. 5x as much, that's important information.

We recently added cost (last week), so data is sparse. Check back in a few weeks and it will be represented somewhere on the homepage, probably in the Efficiency Chart at the bottom. We also plan to show model performance deviation over time after we collect more data. I'm interested to hear about any other data representations you'd like to see, too. The goal is to convey the most important information as densely as…

>I'm interested to hear about any other data representations you'd like to see, too

It would be nice if you can show how much the models drift from the instructions over time

Re: Kimi K2.6: Advancing open-source coding

#386

Earlier quoted context omitted.

Good question. We missed that release entirely. Our automated model checker only went live 2 months ago so they were manually curated prior to that. I'm adding it now. It'll be live in ~12 hours.

Update: Kimi K2.5 one-shot results are live. It wasn't a noteworthy release compared to K2.6: https://gertlabs.com/?mode=oneshot_coding

Can you add C# to supported languages? It's widely used and it be helpful for people and companies to see how different models fare against each other.

Re: Kimi K2.6: Advancing open-source coding

#387

Earlier quoted context omitted.

Why use "their API"? It is an open model, use any provider on OpenRouter

Because sometimes (a lot of the time in my experience) third-party providers and inference engines fail to implement the model correctly in ways that are sometimes very subtle and not obvious. Deepinfra for example is not preserving thinking correctly for GLM5.1, even though they are for GLM5. This is one of the more obvious issues that crop up.

Yeah some of the providers on Openrouter correctly list what quantization they offer. And some refuse to say. OR should kick them off their platform if they want to be secretive.

Re: Kimi K2.6: Advancing open-source coding

#388

Earlier quoted context omitted.

We recently added cost (last week), so data is sparse. Check back in a few weeks and it will be represented somewhere on the homepage, probably in the Efficiency Chart at the bottom. We also plan to show model performance deviation over time after we collect more data. I'm interested to hear about any other data representations you'd like to see, too. The goal is to convey the most important information as densely as…

>I'm interested to hear about any other data representations you'd like to see, too It would be nice if you can show how much the models drift from the instructions over time

Not sure what you mean. Time series chart of model performance over time to see if proprietary models get degraded? That's in the works, but we will need a couple months more data collection before launch.

Re: Kimi K2.6: Advancing open-source coding

#389

Earlier quoted context omitted.

Update: Kimi K2.5 one-shot results are live. It wasn't a noteworthy release compared to K2.6: https://gertlabs.com/?mode=oneshot_coding

Can you add C# to supported languages? It's widely used and it be helpful for people and companies to see how different models fare against each other.

Good idea.

Re: Kimi K2.6: Advancing open-source coding

#390

Earlier quoted context omitted.

China is a ruthless capitalist country managed by an authoritarian regime. Planning and lack of respect for the individual or the rule of law are not communist per se.

> Planning and lack of respect for the individual or the rule of law are not communist per se. They just happen to be a feature of every single country that's attempted communism to date. Total coincidence.

And? Fascism does it, too. Authoritarian rule, such as monarchy, does it too.
Post reply on HN