Earlier quoted context omitted.
This sounds very appealing. What size Mac mini would I need for that?
Personally, I would always max out the RAM you can fit into your budget. You might get lower bandwidth (= slower generation) than you do on a Mac if you choose a Strix Halo or DGX Spark, but there are always new tweaks being discovered to speed things up. That being said, with 32GB you should be able to fit an ok quant of 35B-A3B or 27B with some context, with 64GB you should be golden.
Kimi K2.7 Code is generally available in GitHub Copilot
141–150 of 201 posts
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#142Earlier quoted context omitted.
The biggest appeal of the frontier models is for those trying to get autonomous agentic systems running that do real work with minimal human input. I went down a rabbit hole trying that with frontier models, and after a lot of initial promise it ended up actually slowing me down.
We've all been through that no? In the beginning you can do a ton of stuff without reading code. But the LLMs miss all the good abstractions, they just push and push unmaintainable code until at some point you start having more bugs and then you NEED that LLM to fix the codebase you don't understand anymore. There are guardrails you can and must add to protect your team if you take the vibe approach: a good type syst…
I have to advocate for the vibe-coded mess-colony.
There are applications where it either works or it doesn't, and it's simultaneously obvious whether it does. Think stock price prediction software. I've killed time in the evenings verbally chatting with agents about that specifically, and what emerged worked! It didn't work well, but it clearly outperformed randomness, and I was able to verify that myself easily.
I didn't look at a line of code, but I had an absolute blast.
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#143Earlier quoted context omitted.
Being on Copilot means your employer lets you use it at work. It's essentially Copilot's primary value add in the new billing model.
Cloudflare offers Kimi and GLM
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#144Gotta say, I've lost all interest in cloud-based AI products. Too many cool features and workflows that I was once excited about that I can't or don't use anymore for a variety of reasons (price hikes, subjectively nerfed, disappeared altogether, replaced,...) for me to even remember. It's tiring. I've set up a small rig, mostly settled on Qwen3.6 and I'm slowly adding features myself. It probably can't compete with…
Just wanted to leave a note for folks who might not have the memory to run a big 32gb model - I just found out there are some pruned models that have really good performance and If I had a smaller machine I might try this pruned unsloth Q4 quant of GLM 4.7 flash that sits at 14gb: https://huggingface.co/unsloth/GLM-4.7-Flash-REAP-23B-A3B-GG...
I usually use LM Studio for this type of thing but unsloth has their own studio type app that might be even better suited for these quants.
I used GLM 4.7 flash as my main model for months and it was an incredibly tenacious model and very very fast - I think on restricted hardware, this could be a great choice.
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#145Earlier quoted context omitted.
Personally, I would always max out the RAM you can fit into your budget. You might get lower bandwidth (= slower generation) than you do on a Mac if you choose a Strix Halo or DGX Spark, but there are always new tweaks being discovered to speed things up. That being said, with 32GB you should be able to fit an ok quant of 35B-A3B or 27B with some context, with 64GB you should be golden.
i have issues on a m5/64g with 35b-a3b (mlx) it eventually hits a memory cap around 52gb... but i'm pretty happy with `Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-mlx-8Bit`
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#146Earlier quoted context omitted.
I had a similar experience moving away from Copilot within Zed. Now using the reasonix harness for Deepseek that makes cache hits almost free. And that's with unsubsidized American providers like Digital Ocean or Cloudflare.
I tried using Zed but with local models it constantly breaks on tool calls. I wanted to like it but the smell of vibing is just too much.
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#147Earlier quoted context omitted.
Nice. I paid $6 yesterday for DeepSeek V4 Flash on OpenRouter. That's like $120 dollar for a month, and it's not even a good model.
For DS4 it's much cheaper and reputable to use OpenCode Go $10/mo subscription, or directly with DeepSeek API.
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#148Earlier quoted context omitted.
I had a similar experience moving away from Copilot within Zed. Now using the reasonix harness for Deepseek that makes cache hits almost free. And that's with unsubsidized American providers like Digital Ocean or Cloudflare.
What is the average monthly token price for daily reasonix use?
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#149Earlier quoted context omitted.
We've all been through that no? In the beginning you can do a ton of stuff without reading code. But the LLMs miss all the good abstractions, they just push and push unmaintainable code until at some point you start having more bugs and then you NEED that LLM to fix the codebase you don't understand anymore. There are guardrails you can and must add to protect your team if you take the vibe approach: a good type syst…
Made an account to semi-disagree with you, haha! I have to advocate for the vibe-coded mess-colony. There are applications where it either works or it doesn't, and it's simultaneously obvious whether it does. Think stock price prediction software. I've killed time in the evenings verbally chatting with agents about that specifically, and what emerged worked! It didn't work well, but it clearly outperformed randomness…
Re: Kimi K2.7 Code is generally available in GitHub Copilot
#150Earlier quoted context omitted.
The reason why I was curious is that I am running my stuff on a Strix Halo and I get the feeling that this class of devices ( gmktek, minisforum, lenovo, etc. ) seem to becoming a pretty good alternative
Unified memory feels like the future of consumer hardware, agreed! Do check out r/StrixHalo