Earlier quoted context omitted.
Would having a locally-hosted model offset any of these costs?
Yes, but that comes at the cost of using a dumber llm. The state of the art ones are only available via commercial api, and the best self-hostable models require $10,000+ gpus. This is a problem for coding as smarter really has an impact there, but there are so so so many tasks that an 8b model that runs on a $200 gpu can handle nicely. Scrape this page and dump json? Yeah that’s gonna be fine. This is my conclusion…
Show HN: Klaus – OpenClaw on a VM, batteries included
81–90 of 104 posts
Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#82Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#83Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#84I found ZeroClaw plus Hetzner to be a good option. I've been using it for a week, and it's stable and robust. Complex abilities unlocked calling a FastAPI server with one skill for each endpoint
Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#85Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#86Earlier quoted context omitted.
Yes, but that comes at the cost of using a dumber llm. The state of the art ones are only available via commercial api, and the best self-hostable models require $10,000+ gpus. This is a problem for coding as smarter really has an impact there, but there are so so so many tasks that an 8b model that runs on a $200 gpu can handle nicely. Scrape this page and dump json? Yeah that’s gonna be fine. This is my conclusion…
I saw that the Hetzner matrix like has GPU servers < £300 per month (plus set up fee). I haven't tried it but I think if I was getting up to that sort of spend I'd be setting up Ollama on one of those with a larger Qwen3 max model (which I hear is on par with Opus 4.5?? - I haven't been able to try Qwen yet though so that could be b*****ks).
Re: Show HN: Klaus – OpenClaw on a VM, batteries included
#87Earlier quoted context omitted.
I am still searching for a compose up -d to this day, but without success. And the other poster want me to create a k8s cluster for a bot?!?!
Try mine: https://github.com/skorokithakis/stavrobot It does indeed only need compose up -d.