Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

A guide to local coding models

aiforswes.com

Post reply on HN
Print view View original

91–100 of 363 posts

Re: A guide to local coding models

#91

Post by kristopolous »

simonw wrote: post #4

> I realized I looked at this more from the angle of a hobbiest paying for these coding tools. Someone doing little side projects—not someone in a production setting. I did this because I see a lot of people signing up for $100/mo or $200/mo coding subscriptions for personal projects when they likely don’t need to. Are people really doing that? If that's you, know that you can get a LONG way on the $20/month plans fr…

I use local models + openrouter free ones.

My monthly spend on ai models is I'm not cheap, just ahead of the curve. With the collapse in inference cost, everything will be this eventually

I'll basically do

    $ man tool |
or even

    $ cat source |
Things I used to do intensively I now do lazily.

I've even made a IEITYuan/Yuan-embedding-2.0-en database of my manpages with chroma and then I can just ask my local documentation how I do something conceptually, get the man pages, inject them into local qwen context window using my mansnip llm preprocessor, forward the prompt and then get usable real results.

In practice it's this:

    $ what-man "some obscure question about nfs" 
    ...chug chug chug (about 5 seconds)...
Essentially I'm not asking the models to think, just do NLP and process text. They can do that really reliably.

It helps combat a frequent tendency for documentation authors to bury the most common and useful flags deep in the documentation and lead with those that were most challenging or interesting to program instead.

I understand the inclination it's just not all that helpful for me

Re: A guide to local coding models

#92

Post by didip »

simonw wrote: post #4

> I realized I looked at this more from the angle of a hobbiest paying for these coding tools. Someone doing little side projects—not someone in a production setting. I did this because I see a lot of people signing up for $100/mo or $200/mo coding subscriptions for personal projects when they likely don’t need to. Are people really doing that? If that's you, know that you can get a LONG way on the $20/month plans fr…

When you look at how capable Claude is, vs the salary of even a fresh graduate, combined with how expensive your time is… Even the maximum plan is a super good deal.

Re: A guide to local coding models

#93

Post by beepbooptheory »

cmrdporcupine wrote: post #77
satvikpendem wrote: post #27

Earlier quoted context omitted.

> If that's you, know that you can get a LONG way on the $20/month plans from OpenAI and Anthropic. > The time to cough up $100 or $200/month is when you've exhausted your $20/month quota and you are frustrated at getting cut off. At that point you should be able to make a responsible decision by yourself. These are the same people, by and large. What I have seen is users who purely vibe code everything and run into…

I've been a software developer for 25 years, and 30ish years in the industry, and have been programming my whole life. I worked at Google for 10 of those years. I work in C++ and Rust. I know how to write code. I don't pay $100 to "vibe code" and "learn to program" or "avoid learning to program." I pay $100 so I can get my personal (open source) projects done faster and more completely without having to hire people w…

Why would you ever hire someone to help with a personal open source project?

Re: A guide to local coding models

#94

Post by Muromec »

phainopepla2 wrote: post #71
ardme wrote: post #28

Isnt the math of buying Nvidia stock with what you pay for all the hardware and then just paying $20 a month for codex with the annual returns better?

If you can see into the future and know the stock price, then sure.

The line only ever goes up, until we all cry and find a new false messiah. Or die

Re: A guide to local coding models

#95

Post by satvikpendem »

cmrdporcupine wrote: post #77
satvikpendem wrote: post #27

Earlier quoted context omitted.

> If that's you, know that you can get a LONG way on the $20/month plans from OpenAI and Anthropic. > The time to cough up $100 or $200/month is when you've exhausted your $20/month quota and you are frustrated at getting cut off. At that point you should be able to make a responsible decision by yourself. These are the same people, by and large. What I have seen is users who purely vibe code everything and run into…

I've been a software developer for 25 years, and 30ish years in the industry, and have been programming my whole life. I worked at Google for 10 of those years. I work in C++ and Rust. I know how to write code. I don't pay $100 to "vibe code" and "learn to program" or "avoid learning to program." I pay $100 so I can get my personal (open source) projects done faster and more completely without having to hire people w…

I'm talking about the general trend, not the exceptions. How much of the code do you manually write with the 100 dollar subscription? Vibe coding is a descriptive, not a prescriptive, label.

Re: A guide to local coding models

#96

Post by fny »

My takeaway is that clock is ticking on Claude, Codex et al's AI monopoly. If a local setup can do 90% of what Claude can do today, what do things look like in 5 years?

Re: A guide to local coding models

#98

Post by maranas »

fny wrote: post #96

My takeaway is that clock is ticking on Claude, Codex et al's AI monopoly. If a local setup can do 90% of what Claude can do today, what do things look like in 5 years?

I think they have already realized this, which is why they are moving towards tool use instead of text generation. Also explains why there are no more free APIs nowadays (even for search)

Re: A guide to local coding models

#99

Post by cmrdporcupine »

beepbooptheory wrote: post #93
cmrdporcupine wrote: post #77

Earlier quoted context omitted.

I've been a software developer for 25 years, and 30ish years in the industry, and have been programming my whole life. I worked at Google for 10 of those years. I work in C++ and Rust. I know how to write code. I don't pay $100 to "vibe code" and "learn to program" or "avoid learning to program." I pay $100 so I can get my personal (open source) projects done faster and more completely without having to hire people w…

Why would you ever hire someone to help with a personal open source project?

I wouldn't, but I can pay Claude

Re: A guide to local coding models

#100

Post by dkdcio »

cloudhead wrote: post #49
OptionOfT wrote: post #7

Earlier quoted context omitted.

Eh, these things are trained on existing data. The further you are from that the worse the models get. I've noticed that I need to be a lot more specific in those cases, up to the point where being more specific is slowing me down, partially because I don't always know what the right thing is.

For sure, and I guess that's kind of my point -- if the OP says local coding models are now good enough, then it's probably because he's using things that are towards the middle of the distribution.

similar for me —- also how do you get the proper double dashes —- anyway, I’d love to be able to run CLI agents fully local, but I don’t see it being good enough (relative to what you can get for pretty cheap from SOTA models) anytime soon
Post reply on HN