It surprises me that this concept took as long as it did to gain traction in… hacker news. 15 years ago folks here were compiling kernels and gentoo distros. Lately it’s been “you should just pay the man, it’s cheaper than running these things yourself”
Using an open model feels surprisingly good
11–20 of 157 posts
Re: Using an open model feels surprisingly good
#12Actually, if you break tasks down into small enough units, there's not much difference between open models and closed models. The only reason to use agents is the hope that they'll work with natural language input—but that's where the difficulty lies. For example, if you modify things at the level of small functions, open models seem to perform just as wel
Re: Using an open model feels surprisingly good
#13Re: Using an open model feels surprisingly good
#14This is such a poor quality post, reads more like a diary entry than a substantive technical post.
Re: Using an open model feels surprisingly good
#15Re: Using an open model feels surprisingly good
#16I love OpenCode and the blankness of it too. Clean, light, and manual. It's a good change of pace from what we are used to on the internet (very cool but slow). Also, can you hmu with that modal plan XD
Re: Using an open model feels surprisingly good
#17This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways. What would be useful is a cost metric. I'm curious how much I'd be willing to spend as a premium to not have those companies piping my conversations directly to the NSA. Maybe only some conversations? Claude and OpenAI are heavily subsidized, by all accounts, so Kimi K3 on a private endpoint might end up costing more or less -…
Re: Using an open model feels surprisingly good
#18To be honest, I am surprised by how good DeepSeek V4 Flash is. I use Claude Code and Codex on Claude 5 Opus and GPT-5.6 Sol most of the time, but when I use DS V4 Flash I don't feel like it's really that bad. And with oh-my-pi and just plain pi it's pretty good. To be honest the frontier models are much better at tool calling so in an assistant flow they're better but I did the dumb thing and optimized the harness fo…
I can do things like take a photo of a doctor's note among add the appointment to my calendar, send a PDF to my archive tagged, OCR'd etc, search info from internet, look data from Google Maps.
I can even integrate this to home assistant and talk to my agent with my open source Alexa-like system.
Re: Using an open model feels surprisingly good
#19The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with it. If you’re using it as an aid to traditional software dev, iterating on small, targeted functions, GLM works as good if not better than Claude. Anthropic expects low quality prompts. If you rubber duck GLM, you get absolutely pristine output in most cases.
Re: Using an open model feels surprisingly good
#20The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…