71–80 of 165 posts
Slop. Ask and ye shall receive. In a reply to another comment you claim it's because you couldn't be bothered writing documentation. It seems you couldn't be bothered writing the article on the project "blog" either[0]. My question then - Why bother at all? [0]: https://www.pangram.com/history/dd0def3c-bcf9-4836-bfde-a9e9...
How much should we budget for the LLM? Would "standard" plan suffice?
Or is cost not important because "bro it's still cheaper than hiring Silicon Valley engineer!"
Earlier quoted context omitted.
> but I'm not really sure about calling it "local-first" as it's still reliant on an `ANTHROPIC_API_KEY`. See here: https://github.com/localgpt-app/localgpt/blob/main/src%2Fage...
What reasonable comparable model can be run locally on say 16GB of video memory compared to Opus 4.6? As far as I know Kimi (while good) needs serious GPUs GTX 6000 Ada minimum. More likely H100 or H200.
So weird/cool/interesting/cyberpunk that we have stuff like this in the year of our Lord 2026: ├── MEMORY.md # Long-term knowledge (auto-loaded each session) ├── HEARTBEAT.md # Autonomous task queue ├── SOUL.md # Personality and behavioral guidance Say what you will, but AI really does feel like living in the future. As far as the project is concerned, pretty neat, but I'm not really sure about calling it "local-firs…
Yes this is not local first, the name is bad.
Is 27 MB binary supposed to be small?
Earlier quoted context omitted.
What reasonable comparable model can be run locally on say 16GB of video memory compared to Opus 4.6? As far as I know Kimi (while good) needs serious GPUs GTX 6000 Ada minimum. More likely H100 or H200.
Nothing close to Opus is available in open weights. That said, do all your tasks need the power of Opus?
You could try letting a model decide, but given my experience with at least OpenAI’s “auto” model router, I’d rather not.