Live data from Hacker News

A guide to local coding models

aiforswes.com

211–220 of 363 posts

Re: A guide to local coding models

#211
post #54

Earlier quoted context omitted.

I loathe the idea of being beholden to large corporations for what may be a key part of this job in the future.

And we all know that enshittyfication is coming.

Exactly. Google doesn't show you what it knows is the most appropriate answer, it shows you a compromise between the most appropriate answer and the one that makes them the most money.

Same thing will happen with these tools, just a matter of time.

Re: A guide to local coding models

#214

I never see devs containerize their coding agents. It seems so obvious to me, but I guess people are happy with claude living in their home directory and slurping up secrets.

The devs I work with don't put secrets in their home directories. ;)

many many tools default to this, claude included

Re: A guide to local coding models

#215
post #97
post #96

My takeaway is that clock is ticking on Claude, Codex et al's AI monopoly. If a local setup can do 90% of what Claude can do today, what do things look like in 5 years?

Exactly, imagine what Claude can do in five years!

10% on top of what we have now and the same things that the local models can do of those times ahead of us?

Re: A guide to local coding models

#216

I never see devs containerize their coding agents. It seems so obvious to me, but I guess people are happy with claude living in their home directory and slurping up secrets.

The devs I work with don't put secrets in their home directories. ;)

And where are all their software putting their data then? Unless you consider only private keys to be secrets…

(In particular the fact that Claude Code has access to your Anthropic API key is ironic given that Dario and Anthropic spend a lot of time fearmongering about how the AI could go rogue and “attempt to escape”).

Re: A guide to local coding models

#217
post #203

I am still hoping, but for the moment… I have been trying every 30-80B model that came out in the last several months, with crush and opencode, and it's just useless. They do produce some output, but it's nowhere near the level that claude code gets me out of the box. It's not even the same league. With LLMs, I feel like price isn't the main factor: my time is valuable, and a tool that doesn't improve the way I work…

Claude Code is a lot about prompting and orchestration of the conversation. The LLM is just a tool in these agentic frameworks. Whats truly ingenious is how context is engineered/managed, how is the code-RAG approached, and them LLM memory that is used.

So my guess would be - we need open conversation or something along the line of "useful linguistic-AI approaches for combing and grooming code"

Re: A guide to local coding models

#218

Earlier quoted context omitted.

> If that's you, know that you can get a LONG way on the $20/month plans from OpenAI and Anthropic. > The time to cough up $100 or $200/month is when you've exhausted your $20/month quota and you are frustrated at getting cut off. At that point you should be able to make a responsible decision by yourself. These are the same people, by and large. What I have seen is users who purely vibe code everything and run into…

If this is the new way code is written then they are arguably learning how to code. Jury is still out though, but I think you are being a bit dismissive.

Absolutely not. They're not writing code or performing most of the work that programmers do, therefore they're not [working as] programmers. Their work ends up producing code, but they're not coders any more than my manager is.

A "vibecoder" is to a programmer what script kiddie is to a hacker.

Re: A guide to local coding models

#219

Under current prices buying hardware just to run local models is not worth it EVER, unless you already need the hardware for other reasons or you somehow value having no one else be able to possibly see your AI usage. Let's be generous and assume you are able to get a RTX 5090 at MSRP ($2000) and ignore the rest of your hardware, then run a model that is the optimal size for the GPU. A 5090 has one of the best throug…

These are the comments of the people who will cry a f@cking river when all the f@cking bubbles burst. You really think that it's "$300 total to serve the same amount of tokens as a 5090 can produce in 1 year running constantly"??? Maybe you forgot to read the news how much fucking money these companies are burning and losing each year. So these kind of comments as "to run local models is not worth it EVER" make me chuckle. Thanks for that!

Re: A guide to local coding models

#220
post #23
post #4

> I realized I looked at this more from the angle of a hobbiest paying for these coding tools. Someone doing little side projects—not someone in a production setting. I did this because I see a lot of people signing up for $100/mo or $200/mo coding subscriptions for personal projects when they likely don’t need to. Are people really doing that? If that's you, know that you can get a LONG way on the $20/month plans fr…

Me. Currently using Claude Max for personal coding projects. I've been on Claude's $20 plan and would run out of tokens. I don't want to give my money to OpenAI. So far these projects have not returned their value back to me, but I am viewing it as an investment in learning best pratices with these coding tools.

Me too. I couldn’t build an app that I hope to publish with the $20 plan. The sunk cost will either be reaped back once live, or it’s truly sunk and I’ll move on…..
Post reply on HN