Live data from Hacker News

Kimi K2.7 Code is generally available in GitHub Copilot

github.blog

171–180 of 201 posts

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#171
post #121

Earlier quoted context omitted.

I never got into any of the AI models because it was clear local first was going to be more valueable, if they were to replace coding tasks. I tried out a few models and ended up going with either Qwen3-Coder-Next (no think, just do) and Qwen3.6-35B (thinking, w/llamacpp token budget). Created a customized prompt that works fairly well to around ~60k tokens and then is a toss up on whether it's poisoned itself or I'v…

Cool! Anything you want to share? I haven't looked much into my system prompt yet, do you have any tips?

so opencode has multiple agents for the primary, and that's all I'm doing _but_, I pair it with llamacpp for thinking mode: --reasoning-budget N token budget for thinking: -1 for unrestricted, 0 for immediate end,

N>0 for token budget (default: -1) (env: LLAMA_ARG_THINK_BUDGET)

--reasoning-budget-message MESSAGE message injected before the end-of-thinking tag when reasoning budget

Currently, opencode doesn't do this, but the budget-message could be implemented by a harness to put in custom message. So I tailored an agent with a message that has it either compress the context via dynamic compression plugin or request that it uses a subagent to avoid bloating the context.

It's mildly successful, but you can tell as context size grows it becomes more and more narrow sited or wayward.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#172
post #159
post #135

Earlier quoted context omitted.

The price hike was insane yes, but because they were eating the price difference. How exaclty does moving to a Claude sub is better, when it's actually more expensive ? At my company we did the comparison and Copilot still wins: for 20$ you get a seat and 20$ of usage, whereas with Claude enterprise you get a seat and then usage is completely added. Moreover usage in Copilot is exactly the price of the providers AND…

Last month we consumed all the subscription credits by the 7th day, and had to top the extra credits up every 2-3 days. Last month was definitely not cheaper than a CC subscription. It actually triggered a cost savings effort across the Engineering org (cancelling subscriptions, stopping environments,...) in order to be able to afford AI usage which was not appropriately budgeted for ¯\_(ツ)_/¯ Edit: wording on the co…

> Last month was definitely not cheaper than a CC subscription.

How is that possible? AFAIK copilot charges the same price per token that claude does. They don't offer fixed price subscriptions to enterprise customers (again AFAIK but even if they did presumably they would match the price).

The only exception I'm aware of is volume discounts and you can get those from both copilot and bedrock (and presumably also vertex).

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#173

Earlier quoted context omitted.

People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer. You really don’t need them. After a certain point, bigger models give diminishing returns. If you can get 80% of the productivity gain with a free local model, use the local model. It will still be way faster than doing everything by hand, but you also don’t have to pay for tokens to a…

> People want to make it seem like you need to always use the latest and greatest frontier models to be taken seriously as a developer. Except you kinda do. Try getting a job today without mentioning Claude experience. In another year it'll probably be something else. Saying you like to use Copilot today makes one seem elderly. Not saying you need frontier models on a technical basis, but for career PR you probably d…

[dead]

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#174
post #57

Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…

[deleted]

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#176

Input: $0.95 Cache hit (most important): $0.19 Output: $4.00 This is the same as how much Moonshot charges for it, and it puts it at roughly the price of GPT 5.4 mini, not a bad option. For some context here is a stupid prompt that wastes tokens: "Play a game of tic tac toe against yourself on a 5x5 board, you need 5 in a row to win." It costs $0.006 on Kimi K2.7, and you get to see the whole raw reasoning trace. GPT…

Btw if anyone is wondering, GPT 5.5 does the same garbage as 5.4 mini for 4 times the cost. Fable manages to make a reasonable game, at a cost of 40 cents. X X O O O O O X X X X X X O O X O O X O X O X X O

[deleted]

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#177

Earlier quoted context omitted.

Good summary blog: https://maloyan.xyz/blog/running-qwen-locally-mac-mini-m4

> That's not hypothetical — it's a real measurement on the base model Mac Mini. Hmmm

Yes, I tried out that blog post and concluded that it has llm-written formulations, weird ordering of its alternatives, and LM Studio is the "Step" in its list that works best. The mmap trick certainly does not work.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#178

Earlier quoted context omitted.

This sounds very appealing. What size Mac mini would I need for that?

A 4-bit quantization of either Qwen 3.6 27b or Gemma 4 31b will run on a 32GB Mac with a decent-sized, but not full-sized, context. 64GB gets you the full ~256k context and you don't need to quantize your KV cache (though 8-bit quantization of KV may be worth it for performance). The 4-bit QAT version of Gemma 4 has practically identical performance to the full size version or the 8-bit version in most benchmarks and…

A 4-bit quantization is useless in real projects.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#179

Earlier quoted context omitted.

Watch out for VRAM/RAM. When programs on WSL tired to take more than there was available it was crashing my WSL hard and even corrupting files on the virtual drive attached to WSL in a very strange manner that made recent files just disappear. I had at leat two projects that had to be rebuilt from past conversation with AI because all their files were gone after few crashes. I asked codex to write WSL config to preve…

What are the config settings you needed? TIA

That's my wslconfig file located in my %USERPROFILE% dir:

    [wsl2]
    memory=40GB
    processors=8
    swap=8GB
    swapFile=C:\\wsl-swap.vhdx
    localhostForwarding=true
    guiApplications=false
    vmIdleTimeout=30000
    maxCrashDumpCount=3
    
    [experimental]
    autoMemoryReclaim=gradual

I have 64GB of RAM and 24GB of VRAM.

Re: Kimi K2.7 Code is generally available in GitHub Copilot

#180
all this talk, and the student pack's access to copilot (and i can imagine the free tier) is completely neutered.

you still cannot choose any models nor have much credits to work with (200 per month, around 2 usd). this was luckily the nudge i really needed personally to get out of the vs code paradigm, and i am lowkey glad for it.

overall, we have come full circle where vs code is using a model that one of its fork (cursor) has adapted as the core underlying model for its product.

Post reply on HN