Earlier quoted context omitted.
https://en.wikipedia.org/wiki/Blog
?? Edit: I see, had typo last word of sentence was meant to be “blog”
No, my point is that it's a post on a personal blog not a peer reviewed paper.
Using an open model feels surprisingly good
41–50 of 157 posts
Re: Using an open model feels surprisingly good
#42Earlier quoted context omitted.
I wrote my own OpenClaw one weekend and I am running it as my assistant through Matrix with DeepSeek v4 Flash (and Qwen). It probably costs me about 2 dollars a month and is even more useful than ChatGPT would be due to me having full control on what tools it has access to. I can do things like take a photo of a doctor's note among add the appointment to my calendar, send a PDF to my archive tagged, OCR'd etc, search…
Haha! Love to hear it. That's exactly what I have too: a claw-like[0] system which I originally used Sonnet for and now use my DeepSeek v4 Flash with. In my case, I was foolish enough to run it all on my hardware which is pretty damned fast but has a duty cycle of 5% and runs idle most of the time. It's definitely better done via API. Tell me more about the Alexa-like system! I have mine at home on a custom OpenWakeW…
Privacy is the main benefit of running it yourself. Sending all of your personal info to random providers on openrouter would worry me. I don't mind it for code but if it's connected to my calendar and personal data, I want it running on my machine.
I can't wait until good enough models can run on affordable hardware.
Re: Using an open model feels surprisingly good
#43Earlier quoted context omitted.
You can run a small model on almost any hardware, for free, and just play around. It doesn’t need to be some “frontier” (whatever the hell that means) model by any means. Grab some new tech and slap it on whatever hardware you have laying around, see what you think. Making it about the hardware costs is not the play, they’re not an actual barrier.
> you can run a small model but why?
… to hack. For fun. To play around. Why do anything?
Re: Using an open model feels surprisingly good
#44Re: Using an open model feels surprisingly good
#45The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…
Frontier models like Opus 5 are also extremely good a "research" in an academic sense, including combining elements from different fields or literatures and creating something quite novel sometimes, publishable even, from vague/speculative prompts. This is on top of implementing known methods in about 1/100th of the time it would take by hand, allowing for fast exploration of ideas. They can also roll things out from…
Yeah, the top-end models still feel better at synthesizing and especially simplifying design. Any of the current GPT-5.6 models can overengineer their way around edge cases. Figuring out how to get the same thing without the overengineering and the often-performance-overhead is harder and something that seems to be still more limited to the bigger models. But even the top-end models tend to overdo it first, then only note that it could've been a fifth the code with twice the perf if you push on it to make it realize that some of those edge cases or situations aren't actually relevant to this particular code.
But the situations where you need that are narrowing every release. The "Composer 1" era of low-end models is pretty far away now.
Re: Using an open model feels surprisingly good
#46Earlier quoted context omitted.
I’m the exact same way. $15 on openrouter lasted me so long it would’ve got me fired at FAANG. Despite this, my number of commits is dramatically higher. Small, beautifully scoped changes is just good software development, and good for the wallet as well. I think the issue is that no one is content with incremental progress. We all know one shots are mostly possible, so the age of the personal project is kind of over…
I can see why Anthropic is freaking out right now. China has undermined their whole business. AI models will be basic commodities where hosting providers earn a tiny margin over the raw costs rather than the predicted fortunes from being the gatekeepers to the technology.
Their business model always seemed to be "become IBM, gods of the mainframe and server-side-computing" and that always seemed a bit unlikely to last forever considering how thoroughly the PC disrupted that by being "good enough" without the lock-in.
IMO because they speed-ran it so much (raising orders of magnitudes more, pushing out new stuff orders of magnitudes faster) it will also lead to the rest of the world catching up faster and shrinking the pool of people internal to them who continually benefit compared to what actually went on with IBM. There's only so much upside when you join a company with hundreds-of-billions valuation.
I guess the other part of their business plan bet was "become literal god of AGI". Maybe it'll still happen!
Re: Using an open model feels surprisingly good
#47I’ve enjoyed using Kimi K3. The biggest issue for me so far is finding a good harness. Claude Code is excellent for tasks that require backgrounding processes/agents, or fanning out. Codex and OpenCode I’ve found to be less capable.
Re: Using an open model feels surprisingly good
#48[deleted]
Re: Using an open model feels surprisingly good
#49Earlier quoted context omitted.
Rolling your own Linux is nearly free and could be done on any computer you had lying around. Dropping >$5k on a computer to run a local model (badly) doesn't really scratch my "hacker" itch. The author of this article works for an AI infrastructure company and ran Kimi K3 on their infrastructure - this post reads like marketing.
You can run a small model on almost any hardware, for free, and just play around. It doesn’t need to be some “frontier” (whatever the hell that means) model by any means. Grab some new tech and slap it on whatever hardware you have laying around, see what you think. Making it about the hardware costs is not the play, they’re not an actual barrier.
I don't want to use a crappy model that can't do any of the things I want it to.
I'm not coding with Claude cause I enjoy the inherent novelty of LLMs. I'm doing it cause it's enabling me to quickly solve problems without getting stuck on the hitches that have deterred me from bothering with dozens of side projects my entire life.
Re: Using an open model feels surprisingly good
#50The reason Claude code is so popular is because it’s really good at taking super vague human prose “Claude build me a million dollar SaaS”-type prompts and spitting out thousands of lines of code which cover tons of surface-level edge cases, build in tons of functionality, etc The smaller/open models are less good at that. But that’s not how software development is done. You don’t prompt a whole app and be done with…
This is what I've found and would likely be the consenses of the HN community.
This has lowered the barrier of entry for many non-SWEs. I'm primarily a data scientist myself in the environmental sector with limited front end development.
My partner proposed an idea to help manage her horses and over the course of several weeks we fleshed out an android app that would enable/assist her with horse care.
I spent a few days in planning mode pointing claude to the services we want to utilise and the functionality.
We now have a fully developed app that we are testing but found several features missing. For example, Claude implement X but without a level of verbosity it failed to implement the edit/deletion of X.
The app is highly tailored to her use case and I had already built the main parts as a POC but she had no user-friendly method to interact with the information she required. Claude made this possible in such a quick time frame that just seems insane. As someone time poor (as most horse people are), it would have taken me a year+ to produce something unpolished when compared to what Claude produced.