Kimi K2.7 Code is generally available in GitHub Copilot • Hacker News Board

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#121

Post by c7b » Thu, Jul 02, 2026, 2:41 PM UTC

cyanydeez wrote: post #74

c7b wrote: post #57

Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…

I never got into any of the AI models because it was clear local first was going to be more valueable, if they were to replace coding tasks. I tried out a few models and ended up going with either Qwen3-Coder-Next (no think, just do) and Qwen3.6-35B (thinking, w/llamacpp token budget). Created a customized prompt that works fairly well to around ~60k tokens and then is a toss up on whether it's poisoned itself or I'v…

Cool! Anything you want to share? I haven't looked much into my system prompt yet, do you have any tips?

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#122

Post by c7b » Thu, Jul 02, 2026, 2:47 PM UTC

blensor wrote: post #103

JSR_FDED wrote: post #100

Earlier quoted context omitted.

I assumed the 27B dense model would be preferable to a MoE model, and that it wouldn’t fit into a consumer graphics card, which leaves the Macs. Then I assumed for cost and battery/heat reasons that a Mini would be better than a laptop.

The reason why I was curious is that I am running my stuff on a Strix Halo and I get the feeling that this class of devices ( gmktek, minisforum, lenovo, etc. ) seem to becoming a pretty good alternative

Unified memory feels like the future of consumer hardware, agreed! Do check out r/StrixHalo

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#123

Post by deadbabe » Thu, Jul 02, 2026, 2:48 PM UTC

c7b wrote: post #57

Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…

People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer.

You really don’t need them. After a certain point, bigger models give diminishing returns. If you can get 80% of the productivity gain with a free local model, use the local model. It will still be way faster than doing everything by hand, but you also don’t have to pay for tokens to a cloud provider and the tools won’t be ripped away from you on a whim.

This is the new attitude enlightened people should adopt. Reject the arms race.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#124

Post by organsnyder » Thu, Jul 02, 2026, 2:58 PM UTC

deadbabe wrote: post #123

c7b wrote: post #57

Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…

People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer. You really don’t need them. After a certain point, bigger models give diminishing returns. If you can get 80% of the productivity gain with a free local model, use the local model. It will still be way faster than doing everything by hand, but you also don’t have to pay for tokens to a…

The biggest appeal of the frontier models is for those trying to get autonomous agentic systems running that do real work with minimal human input. I went down a rabbit hole trying that with frontier models, and after a lot of initial promise it ended up actually slowing me down.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#125

Post by ravenstine » Thu, Jul 02, 2026, 3:03 PM UTC

deadbabe wrote: post #123

c7b wrote: post #57

Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…

People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer. You really don’t need them. After a certain point, bigger models give diminishing returns. If you can get 80% of the productivity gain with a free local model, use the local model. It will still be way faster than doing everything by hand, but you also don’t have to pay for tokens to a…

> People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer.

Except you kinda do. Try getting a job today without mentioning Claude experience. In another year it'll probably be something else. Saying you like to use Copilot today makes one seem elderly.

Not saying you need frontier models on a technical basis, but for career PR you probably do.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#126

Post by pimeys » Thu, Jul 02, 2026, 3:06 PM UTC

organsnyder wrote: post #124

deadbabe wrote: post #123

Earlier quoted context omitted.

People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer. You really don’t need them. After a certain point, bigger models give diminishing returns. If you can get 80% of the productivity gain with a free local model, use the local model. It will still be way faster than doing everything by hand, but you also don’t have to pay for tokens to a…

The biggest appeal of the frontier models is for those trying to get autonomous agentic systems running that do real work with minimal human input. I went down a rabbit hole trying that with frontier models, and after a lot of initial promise it ended up actually slowing me down.

We've all been through that no? In the beginning you can do a ton of stuff without reading code. But the LLMs miss all the good abstractions, they just push and push unmaintainable code until at some point you start having more bugs and then you NEED that LLM to fix the codebase you don't understand anymore.

There are guardrails you can and must add to protect your team if you take the vibe approach: a good type system, a good database with clearly written business model and a good data model to drive your business. Make it loud and clear when something breaks with your tooling.

But... I'd definitely not vibe everything after a certain point. Reading and fixing code is also a lot of fun.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#127

Post by adastra22 » Thu, Jul 02, 2026, 3:06 PM UTC

blensor wrote: post #103

JSR_FDED wrote: post #100

Earlier quoted context omitted.

I assumed the 27B dense model would be preferable to a MoE model, and that it wouldn’t fit into a consumer graphics card, which leaves the Macs. Then I assumed for cost and battery/heat reasons that a Mini would be better than a laptop.

The reason why I was curious is that I am running my stuff on a Strix Halo and I get the feeling that this class of devices ( gmktek, minisforum, lenovo, etc. ) seem to becoming a pretty good alternative

Strix Halo is better performance than a Mac Mini, but not as good as a Mac Studio. But the 128GB unified memory is awesome for larger models.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#128

Post by c7b » Thu, Jul 02, 2026, 3:06 PM UTC

maykthewessen wrote: post #77

cyanydeez wrote: post #74

Earlier quoted context omitted.

I never got into any of the AI models because it was clear local first was going to be more valueable, if they were to replace coding tasks. I tried out a few models and ended up going with either Qwen3-Coder-Next (no think, just do) and Qwen3.6-35B (thinking, w/llamacpp token budget). Created a customized prompt that works fairly well to around ~60k tokens and then is a toss up on whether it's poisoned itself or I'v…

Qwen is the Alibaba distilled Anthropic Claude model So piracy on an by piracy trained ai model..

I'm not sure what you're trying to say. Is that a good or a bad thing? Model distillation is presumably part of the reason why Qwen is so good, yes. As a consumer, that's a good thing I would say. It's a natural counterbalance to the monopolistic tendencies of other tech segments.

If you have ethical concerns, model distillation feels like an arbitrary line to draw. Why is the first type of piracy ok, the second not? You should restrict yourself to ethical open source models. Which is btw where I genuinely hope the future of local models is going to lie. Open weights is not enough, we need fully open source models to be sustainable. Even for simple things like updating the knowledge cutoff. How we are going to distribute the training effort will be an interesting problem where I don't see an obvious solution yet. Maybe the blockchain/federated learning people can suggest something. Or university consortia, or some public sector solutions. Or something really boring - I for one would absolutely be willing to pay for DRM-free weights of an open source model (even if I could pirate them for free).

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#129

Post by SV_BubbleTime » Thu, Jul 02, 2026, 3:07 PM UTC

piyh wrote: post #119

unleaded wrote: post #80

Earlier quoted context omitted.

Qwen3.6-35B-A3B-UD-Q4_K_M runs at about 11 tokens/second on my poor old 1060. Absolutely nuts how far we've come

I tried running any model on my 1070 and it instantly crashes my old tower, probably time to get off windows and run linux on it.

Understated how much of a boon for Linux that AI development has been.

There isn’t any benefit to running a windows machine.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#130

Post by selectodude » Thu, Jul 02, 2026, 3:09 PM UTC

SV_BubbleTime wrote: post #129

piyh wrote: post #119

Earlier quoted context omitted.

I tried running any model on my 1070 and it instantly crashes my old tower, probably time to get off windows and run linux on it.

Understated how much of a boon for Linux that AI development has been. There isn’t any benefit to running a windows machine.

Au contraire, I run models on WSL and my desktop reliably wakes up from sleep. Best of both worlds.