[flagged]
Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
531–540 of 620 posts
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#532[dead]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#533No. I've tried all the OS models up to Qwen 480B and Kimi (the biggest models). None come even close to Claude. I do mostly scripting, devops, data processing and systems stuff (ansible playbooks, managing network devices, deploying new software for various things that involves reading docs, writing helm charts, modifying existing ones etc). All other models Gemini, Chatgpt, grok and all OS models don't come even clo…
> I'd rather use Sonnet than Qwen
I get this, though the pace of Chinese releases is relentless. Qwen3.7 Plus/Max (closed variants) feel notably better than Qwen3.6, and Minimax M3 is a big jump from 2.7 in capability as well. Both of these families had their previous major release less than 90 days ago.
Anthropic must have Sonnet 5 either waiting or cooking though, they said smaller and larger models than Opus were coming and we already briefly had the larger model.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#534Not “local” and not interactive coding but sharing since it might be helpful. I have 2x RTX Pro 6000 Blackwell running DeepSeek V4 Flash. I get 160 tok/s raw but it’s a reasoning model. For my use case, I have it auto-write code and another system auto-review the code. I occasionally use it with pi to write some code and it’s blazing fast but it’s mostly habit that keeps me with CC and Codex.
What quant?
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#535[flagged]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#536Earlier quoted context omitted.
Hopefully this isn't off-topic, but your setup sounds just like mine, Strix Halo and (I'm assuming) llama.cpp on ROCm, and I'm finding that the Qwen hybrid models don't handle prompt caching and instead re-process the context in full on every turn. I'm wondering if you were able to solve this and how?
What harness are you using? Some of them (e.g. OpenCode) mutate the system prompt every turn, and therefore can't work with a KV cache. I've had the best luck with Pi so far, but it comes without some bells and whistles you might be used to (e.g. plan mode, subagents, MCP client support)
[flagged]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#537I'm looking forward to having Claude Fable at home. THAT is when I'll THINK about replacing Claude (who knows what their next models will be capable of, Fable was damn good for the three days I had it).
we keep moving the goalposts on when we're gonna be happy with local. first it was sonnet at home as the good enough, then opus, now it's the mysterious leading model that runs on infrastructure we can't feasibly have at home
I don't know about "we" but for me, I've never been happy with any of the models to bother with learning how to run one at home. I've got a Turing Pi and a bunch of other gadgets just sitting in a box (well the former I've got running after owning for several years of non-use).
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#538[dead]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#539Earlier quoted context omitted.
> you really need to know what you're asking, and be precise Any chance that you could share some recent prompts to give other HNers a head start on his to approach Qwen? If you are uncomfortable posting them here, my Gmail username is the same as my HN username. Thank you.
I'm glad you're asking. I already started writing a blog post on how to best make use of local models. I'll share it as soon as I have a complete enough list. If anyone else reading this would like to chime in with their tips & tricks, let us know! For the time being, off the top of my head, I'd say: - Prompt Engineering tips & tricks apply here (like being complete in the relevant context you provide in your questio…
Is there a way to be notified of your blog post on this?
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#540[flagged]