Live data from Hacker News

Using an open model feels surprisingly good

matthewsaltz.com

51–60 of 157 posts

Re: Using an open model feels surprisingly good

#51

I love OpenCode and the blankness of it too. Clean, light, and manual. It's a good change of pace from what we are used to on the internet (very cool but slow). Also, can you hmu with that modal plan XD

Pi Agent is even leaner feeling, it's worth a try.

Will do! Heard a lot of great things about it from my friends.

Re: Using an open model feels surprisingly good

#52
post #9

This is only a thinly veiled ad. It's fine, I was curious about this exact setup, anyways. What would be useful is a cost metric. I'm curious how much I'd be willing to spend as a premium to not have those companies piping my conversations directly to the NSA. Maybe only some conversations? Claude and OpenAI are heavily subsidized, by all accounts, so Kimi K3 on a private endpoint might end up costing more or less -…

With OpenRouter this is pretty easy to see - each model page has various providers listed along with an icon marking providers with zero data retention, and the price. You can also set up an account-wide "guardrail" to prevent routing to non-ZDR providers.

OpenAI and Anthropic also claim they don't retain data. I'm not sure what it would take for me to trust any of these inference companies, and why I should trust them more than the big ones.

Re: Using an open model feels surprisingly good

#53
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

Personally I've found Deepseek v4 Flash to be as useful to me as Opus. But I don't do these silly one shot tech demos. I have the technical understanding to ask for exactly the change I want with the right terminology. I loaded up some credit on openrouter and it took me ages to hit $1 in spend.

[dead]

Re: Using an open model feels surprisingly good

#54
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

> The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with it.

After open models will also be able to do that, I expect everyone to forget "how software development is done".

Re: Using an open model feels surprisingly good

#55

I’ve enjoyed using Kimi K3. The biggest issue for me so far is finding a good harness. Claude Code is excellent for tasks that require backgrounding processes/agents, or fanning out. Codex and OpenCode I’ve found to be less capable.

I suspect FOSS will converge/create a best-in-class harness within the next 6 months or so. As will most (all?) software, the FOSS stuff somehow always ends up being way better than the closed source stuff.

Re: Using an open model feels surprisingly good

#56

I’ve enjoyed using Kimi K3. The biggest issue for me so far is finding a good harness. Claude Code is excellent for tasks that require backgrounding processes/agents, or fanning out. Codex and OpenCode I’ve found to be less capable.

I suspect FOSS will converge/create a best-in-class harness within the next 6 months or so. As will most (all?) software, the FOSS stuff somehow always ends up being way better than the closed source stuff.

Is there any resource or benchmark actually comparing how different harnesses perform with a given model?

Really just feels like endless FOMO with how fast the iteration cycle is for harness and model development.

Re: Using an open model feels surprisingly good

#57
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

Sorry to be pedantic, but I believe this is a major source of confusion: Claude "Code" is not a model.

Re: Using an open model feels surprisingly good

#58
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

This is what I've found and would likely be the consenses of the HN community. This has lowered the barrier of entry for many non-SWEs. I'm primarily a data scientist myself in the environmental sector with limited front end development. My partner proposed an idea to help manage her horses and over the course of several weeks we fleshed out an android app that would enable/assist her with horse care. I spent a few d…

this is why i think LLMs is a foundational technology like the Internet. there is no other technology on the horizon that have this much impact.

Re: Using an open model feels surprisingly good

#59
post #19

The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…

Sorry to be pedantic, but I believe this is a major source of confusion: Claude "Code" is not a model.

Claude code is a (pretty good) harness. Any other harness I try, I realized at some point, I’m just wishing it worked as well as CC does

Re: Using an open model feels surprisingly good

#60
post #31
post #18

Earlier quoted context omitted.

I wrote my own OpenClaw one weekend and I am running it as my assistant through Matrix with DeepSeek v4 Flash (and Qwen). It probably costs me about 2 dollars a month and is even more useful than ChatGPT would be due to me having full control on what tools it has access to. I can do things like take a photo of a doctor's note among add the appointment to my calendar, send a PDF to my archive tagged, OCR'd etc, search…

Haha! Love to hear it. That's exactly what I have too: a claw-like[0] system which I originally used Sonnet for and now use my DeepSeek v4 Flash with. In my case, I was foolish enough to run it all on my hardware which is pretty damned fast but has a duty cycle of 5% and runs idle most of the time. It's definitely better done via API. Tell me more about the Alexa-like system! I have mine at home on a custom OpenWakeW…

Nice setup. Which home assistant do you use? I would love to bring alexa like capability to my setup.
Post reply on HN