Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is the next big thing locally running coding agents?

news.ycombinator.com

Post reply on HN
Print view View original

11–17 of 17 posts

Re: Ask HN: Is the next big thing locally running coding agents?

#14

Post by potsandpans »

I agree. I run gemma4 31b int4 quant on my 5090 and find that's it's quite capable for self contained tasks. There are larger open weights models that are more capable, such as minimax and glm5.1.

I've toyed with the idea of buying two rtx 6000s and vlinking them. But the cost benefit value prop doesn't really pan out quite yet, still cheaper to use open router / some subscription plan for open weights.

I'm looking forward to continued optimization from the open weights labs / models. Qwen and gemma4 are quite capable.

Also I feel what's really under utilized is a suite of llm/ai tools that are completely open and runnable locally.

Hunyuan 3d 2.0, trellis2, unirig

Flux 2 dev, z image, qwen image edit

Ltx 2.3 / wan

Ace step 1.5

All great for creation pipelines. Couple those with other smaller things like sam2 and dino. It's very exciting to see these things producing high quality on local systems.

Re: Ask HN: Is the next big thing locally running coding agents?

#15

Post by jonahbenton »

baigy wrote: post #5
jonahbenton wrote: post #3

There are many markets. Qwen 3.6 27b at a high enough quant is good enough for many use cases. But enterprise-consumed tokens come with legal/data protection agreements. They have just gotten comfortable with BYOD- there is no BYOD equivalent set of practices and protections for local LLMs (BYOLLM). So some enterprises are getting back into prem GPU capacity.

On prem GPU capacity - or decent enough devices for core engineering team - lends itself pretty nicely to local LLMs too. And you own the whole stack this way. Why pay premiums to Anthropic and fuel its trillion dollar valuation?

Yeah...pay opex to Anthropic or your capex to NVidia- whose Blackwell gen prices are now up 25% from launch, with more increases to come.

Re: Ask HN: Is the next big thing locally running coding agents?

#16

Post by damnitbuilds »

damnitbuilds wrote: post #2

I got Qwen 3.6 running locally on 12GB VRAM. It went: AI: "I see you are building a Django project. How can I help?" Me: "When I click on the Reload button, it does not set the reload option correctly. Fix this" AI: "I see you are building a Django project. How can I help?" Needs more tweaking of the context window, I think. Seriously, I agree that this is the future, when OpenAI et al have gone bust.

I tweaked it and now I get good, better-than-Copilot answers, on local hardware but a little bit slower than Copilot ( okay, ~10min vs ~1 minute ).

I can take that for the joy of running this locally !

Post reply on HN