Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
21–30 of 620 posts
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#22Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#23Tried. The context windows just weren't big enough.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#24Results depend on the model, of course, and your computer is the limit. Mine wasn't up to the task, unfortunately.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#25Not “local” and not interactive coding but sharing since it might be helpful. I have 2x RTX Pro 6000 Blackwell running DeepSeek V4 Flash. I get 160 tok/s raw but it’s a reasoning model. For my use case, I have it auto-write code and another system auto-review the code. I occasionally use it with pi to write some code and it’s blazing fast but it’s mostly habit that keeps me with CC and Codex.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#26Every month I research this and come to the same conclusion: the time, effort, and cost required to get local models (and the coding tools around them) to perform even close to Claude Code with sonnet/opus just not worth it right now. If it was, it would be distributive enough to be in the news.
Not that I'm discounting someone hasn't already solved this, just trying to Occam razor my way out of diving too deep down rabbit holes.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#27Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#28Pretty good results with qwen 3.6 27b dense. I’d say it’s about equal to (Claude) haiku 4.5 maybe sonnet depending on the task.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#29Can't compare it to SOTA or higher-requirements models on what I work on - policy. That said, on a bunch of test pieces - it obviously isn't gpt-5.5, it definitely lags behind k2.6/glm/ds4-pro, but it absolutely is usable. Of course, on such codebases, forget about one-shotting or trusting it blindly or anything of the sort - you ask it, guide it, restart the context from time to time to have a "fresh dice roll" and to keep the context small and clean, etc. Compared to anything smaller (incl. all the usual local qwen models) - on a test piece, it figured out that memfd and mmap were used for setting up a ring buffer with natural wraparound handling (double mapping the first page at the end) and didn't tell me "this is for sharing memory between processes" or some other BS.
Performance as described in the tables in the readme here: https://github.com/antirez/ds4 ...with a bit less than half that at "low power" (30w). Both are usable.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#30Disclaimer: I am a Linux infra/k8s guy, I write production code but it's mainly glue code and mainly in golang.
Addendum: most value we get is from "document intelligence" and that's all Gemma and Qwen on H100/H200