Live data from Hacker News

Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

github.com

151–160 of 165 posts

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#151
post #4

So weird/cool/interesting/cyberpunk that we have stuff like this in the year of our Lord 2026: ├── MEMORY.md # Long-term knowledge (auto-loaded each session) ├── HEARTBEAT.md # Autonomous task queue ├── SOUL.md # Personality and behavioral guidance Say what you will, but AI really does feel like living in the future. As far as the project is concerned, pretty neat, but I'm not really sure about calling it "local-firs…

What does ANTHROPIC bring to this project that a local LLM cannot, e.g. Gwen3 Coder Next?

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#152

Earlier quoted context omitted.

Yes this is not local first, the name is bad.

Horrible. Just because you have code that runs not in a browser doesn't mean you have something that's local. This goes double when the code requires API calls. Your net goes down and this stuff does nothing.

Not to mention that you can actually have something that IS local AND runs in a browser :D

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#153
post #38
post #4

So weird/cool/interesting/cyberpunk that we have stuff like this in the year of our Lord 2026: ├── MEMORY.md # Long-term knowledge (auto-loaded each session) ├── HEARTBEAT.md # Autonomous task queue ├── SOUL.md # Personality and behavioral guidance Say what you will, but AI really does feel like living in the future. As far as the project is concerned, pretty neat, but I'm not really sure about calling it "local-firs…

> Say what you will, but AI really does feel like living in the future. Love or hate it, the amount of money being put into AI really is our generation's equivalent of the Apollo program. Over the next few years there are over 100 gigawatt scale data centres planned to come online. At least it's a better use than money going into the military industry.

Most of these AI companies are part of the military industry. So the money is still going there at the end of the day.

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#155
post #138
post #86

Earlier quoted context omitted.

That’s probably true only as long as subscription prices are kept artificially low. Once the $20 becomes $200 (or the fast-mode inference quotas for cheap subs become unusably small), the equation may change.

This field is highly competitive. Much more than I expected it to. I thought the barrier to entry was so high, only big tech could seriously join the race, because of costs, or training data etc. But there's fierce competition by new or small players (deepseek, Mistral etc), many even open source. And Icm convinced they'll keep the prices low. A company like openai can only increase subscriptions x10 when they've loc…

There's no way around the cost of electricity, at least in the short term. Nobody has come up with a way to meaningfully scale capacity without scaling parameter count (≈energy use). Everybody seems to agree that the newest Claudes are the only coding models capable of some actually semi-challenging tasks, and even those are prone to all the usual failure modes and require huge amounts of handholding. No smaller models seem to get even close.

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#156
post #2

Pro tip (sorry if these comments are overdone), write your posts and docs yourself (or at least edit them). Your docs and this post is all written by an LLM, which doesn't reflect much effort.

People have already fried that part of their brain, the idea of writing more than a couple sentences is out of the question to many now. These plagiarism laundering machines are giving people a brain disease that we haven't even named yet.

post-ai-laziness-disorder (PALD)

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#157

Earlier quoted context omitted.

Yes this is not local first, the name is bad.

Horrible. Just because you have code that runs not in a browser doesn't mean you have something that's local. This goes double when the code requires API calls. Your net goes down and this stuff does nothing.

For a web developer local-first only describes where the state of the program lives. In the case of this app that’s in local files. If anthropics api was down you would just use something else. Something like OpenRouter would support model fallbacks out of the box

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#158

Earlier quoted context omitted.

I'm playing with local first openclaw and qwen3 coder next running on my LAN. Just starting out but it looks promising.

On what sort of hardware/RAM? I've been trying ollama and opencode with various local models on a 16Gb RAM, but the speed, and accuracy/behaviour just isn't good enough yet.

DGX Spark (128gb)

Re: Show HN: LocalGPT – A local-first AI assistant in Rust with persistent memory

#159
post #119

not sure what’s the point of using/highlighting rust here. low-level language for a high-level application with IO-bound latency.

Codex is also in rust, no other modern language can compete. Maybe another older low level language. It's perfect for this kind of application.

I think the point is, what does it add to the discussion mentioning the language it is written in?

This is a rust trait. Titles farm karma like that because "Presenting: myapp" vs "Presenting: myapp written in rust", the latter will receive more attention.

Post reply on HN