This is nice! I tried it for a bit and it was indeed quite fast.
Are you looking for contributors, or are you building this as a personal tool?
I ran into some issues when attempting to use different models, though: gpt-5.5 on Azure doesn't work, even with the OpenAI compatible endpoint, because "max_tokens" has been replaced with "max_completion_tokens". And it doesn't appear possible to pass through custom headers, so I wasn't able to specify reasoning_effort for deepseek models.
Zerostack – A Unix-inspired coding agent written in pure Rust
91–100 of 334 posts
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#92Now make it into an IntelliJ plugin which has proper access to the search index. I’ll pay for it. For Christs sake it’s insane JetBrains hasn’t figured this out yet
Jetbrains does not have their own IDE-integrated coding agent? What do Jetbrains users use then? Amp?
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#93I absolutely like this. Pi becomes sluggish after installing a couple of extensions. I myself was trying to port Pi to Rust but it was consuming too much tokens. Is there any API like Pi so that I can create extensions.
It absolutely doesn't. It must be the extensions you're using. I've found is that nearly every extension on the official pi.dev/packages is vibe coded trash, like for example the most popular subagents extension. Instead of just giving you a basic subagent, it's a whole kitchen sink of recursion, teams, chains, confusingly named agents like "oracle" etc. Basically feels like someone kept prompting "what else could we…
Still they are maintained by those developers. I cannot spend my time developing extensions. I'd rather do that in Rust.
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#94Earlier quoted context omitted.
The context window has nothing to do with RAM usage and even if it did, a million tokens of context is maybe 5mb.
'A million tokens of context' is literally Terrabytes of KV cache VRAM on very expensive Nvidia silicon - on the model. On the Agent, yes, the context window does relate to RAM, because the 'entire conversational history' is generally kept in memory. So ballpark 1M 'words' across a bunch of strings. It's not that-that much. Claude Code is not inneficient because 'it's not Rust' - it's just probably not very efficient…
Rust "denialism" is as annoying as rust evangelism.
Of course any seemingly idiomatic rust is going to run circles around TS transpiled into JIT-compiled JS.
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#95Earlier quoted context omitted.
The context window is not on your system. It's on the server with the model. There may be some local prompt caching, of some sort, but you're not locally hosting the context unless you're also locally hosting the model.
Chat history is kept locally, generally you have to send the 'whole history' to the model 'each turn'.
Only "generally"? I'm curious what API has moved away from this protocol that seems mode adapted to conversaions with humans than agentic loops.
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#96Does anyone use claude with custom agents? IIRC they banned the use, and only allow claudes own agent.
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#97This is much needed! Compared to Codex CLI, Claude Code is insanely slow. $ time claude --version 2.1.143 (Claude Code) ________________________________________________________ Executed in 4.39 secs fish external usr time 29.68 millis 0.26 millis 29.41 millis sys time 71.30 millis 1.30 millis 70.00 millis 5 seconds to show me the version number! I'm guessing Claude Code also needs a rewrite in Rust. But from what I s…
Note that includes network requests to check latest version.
I suspect we'll soon see someone make a persistent Claude shell mode, with the reverse of a !, where you work in shell and send a message to Claude, and Claude sees all the context.
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#98Does anyone use claude with custom agents? IIRC they banned the use, and only allow claudes own agent.
You can use Claude with other harnesses at API costs, but you cannot use it with your Claude Code sub. That's changing next month though, I guess https://support.claude.com/en/articles/15036540-use-the-clau...
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#99The key thing with pi is that it can extend itself. How does that work when it’s written in rust?
Re: Zerostack – A Unix-inspired coding agent written in pure Rust
#100Earlier quoted context omitted.
Chat history is kept locally, generally you have to send the 'whole history' to the model 'each turn'.
Only "generally"? I'm curious what API has moved away from this protocol that seems mode adapted to conversaions with humans than agentic loops.
So the standard API you pass it all along but I think there are some odd open ai apis that are different.