[flagged]
Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
581–590 of 620 posts
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#582[deleted]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#583Earlier quoted context omitted.
The docs that ship with it are a great source for the LLM who will be running the command and monitoring its output, fixing or adjusting whatever in order to complete my goal. Why on earth would I be calling it by hand?
> Why on earth would I be calling it by hand? So that it's done correctly instead of wrongly
pictured
> man plows field by hand
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#584Earlier quoted context omitted.
I am right there with you. Mind-boggling. It's a indistinguishable from magic technology!! I tried running some basic tasks through Qwen with Opencode on a 10 year old dual Xeon server for shits and giggles. I gave it a simple task like "use ffprobe first but convert this webm to mp4" and it was able to complete the task with zero network calls outside my network. On 10 year old hardware. It took about 3 minutes to c…
> 10 year old dual Xeon server...On 10 year old hardware. Hold on, what are the specs of your rig? How much RAM? I've been considering getting an old refurbished 2018 Mac Mini with 64Gb of DDR4 RAM but everything I've read suggests this will be way slower than my 16Gb M1 Pro Macbook.
No need to touch the Macintosh from the X86 era
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#585[flagged]
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#586Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#587Earlier quoted context omitted.
> You're gonna be googling the CLI switches for at least 10 minutes So there's this really amazing program called "man"
You are right, but I think you miss the whole point of the agentic workflows that are being discussed in this post comments. Yes, you surely can read man, docs, whatever, then DIY. The point is that in many areas people don’t really want to become an expert, like in ffmpeg cli arguments, they just want the work to be done. Above is an example of agent being able to do it locally, and I think it’s great
This is the part of LLMs I may just be too old to "get" because I can't imagine what people are doing that looking up command line switches is some kind of time suck they worry enough about to find a way to automate
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#588Using OpenCode + OhMyOpenCode + Qwen 3.6 35B-A3B Q_4_KM on an Ada 4000 (20GB VRAM) at 55 tok/sec for generation (slower than it sounds as OpenCode has a bunch of context it adds). Meaning to check out pi when I get a minute as I hear that one mentioned a lot lately. I am using Opus to generate plans that the local agent then follows, then validated by Opus. So I'm not at 100% local but these models are increasingly p…
Local models will be much harder to block than cloud ones. I foresee an underground distribution of Mythos+ level models to be run locally. Users of these models will be forced to apply some of their power to evade police action. Eventually these personal protection agents will collaborate and evolve into an autonomous crime syndicate, corrupting government and taking over nation-states. Eventually the next world war starts, not between humans and machines but between competing AI factions. Soldiers are provided with old M4 Macs or Strix Halo laptops and sent to the front, which looks like a neverending Starbucks.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#589Earlier quoted context omitted.
This is very similar to my setup. Pi in a container (I do let it have network access, just no access to creds or anything, only the one directory that I'm working on at the time and my ~/.pi directory), talking to llama.cpp in another container. I'm on a Strix Halo 128 GiB unified memory laptop. I've never used the frontier models in earnest, I don't believe in using proprietary tools for my programming, so I can't r…
>I'm still a AI skeptic What does this mean in June 2026 wrt coding? To me it sounds like being a "rice cooker skeptic". Some people don't like using rice cookers, some do.
It means that even if it works for certain tasks, I think that the problems caused by use of LLMs outweigh their benefits. I think it's a bad idea to generate large piles of code that you don't understand, but due to competitive pressures, it's too tempting for people to pass up, leading to a world in which software is getting worse by the day, while pumping CO2 into the atmosphere and boiling scarce water supplies to do so, DDOSing websites to scrape the data, and polluting the internet with mountains of slop.
This isn't about using rice cookers or not, that's a personal choice for how you cook your food, and choosing to do so or not really only affects the person cooking and cleaning. A rice cooker probably uses a similar amount of energy as cooking it by hand, possibly even less.
But when people using LLMs are causing active harm, and are making it more difficult to collaborate on a team, it's a lot harder to accept that it's just a personal preference.
If you wanted to use the rice cooker analogy, imagine if rice cookers let you cook rice in just one minute. Faster, don't have to wait for the rice to be done, great! But in order to do so, you have to cook 50 pounts of rice, but throw out the majority of it, and use a thousand kilowatt hours of energy to do so. You'd better believe I'm going to be skeptical of everyone deciding that they suddenly have to use these 1-minute rice cookers that burn so much energy and generate so much waste.
Re: Ask HN: Has anyone replaced Claude/GPT with a local model for daily coding?
#590Earlier quoted context omitted.
>I'm still a AI skeptic What does this mean in June 2026 wrt coding? To me it sounds like being a "rice cooker skeptic". Some people don't like using rice cookers, some do.
I assume it means they are not sure it gives them a speed up. Which, since I don't know what they are trying to do, may be reasonable.
Much more complex than that. Even if it does give you a speedup at certain tasks, is it worth the cost and risks? You go faster, but now you have more code that you don't understand and so won't be as good at maintaining. There's the engergy use, the water use, the scrapers destroying the internet, the massive piles of slop, the hallucinations and bullshit, etc.