251–260 of 334 posts
I understand the need for memory footprint in some situations, but what's the point of seeking performance for a software that mostly calls LLMs and waits?
Starting with a resource-saving attitude may be a very good long term strategy.
Also: with Rust there are many features of high-level, modern, type-safe, FP-inspired languages that you do not have to miss.
Earlier quoted context omitted.
huh. my evidence with codex hasn’t been so bad. and tbh why would i discourage anyone from coding. hack away mr hacker. your solution will either sink or swim
codex is in rust and not in power and memory hungry js/ts.
Now I tried to install zerostack, but the compilation freezes at a certain package.
Is there a static binary available for linux?
Earlier quoted context omitted.
When you write Rust long enough you settle on certain architectures (message passing, event loops) that go well with the borrow checker, and don't end up thinking about it too much. Plus you can always throw an agent at the first set of errors from the refactor and let the compiler guide the annoying parts.
> When you write Rust long enough you settle on certain architectures (message passing, event loops) that go well with the borrow checker So basically Go?
The type system of Go is very weak. I'd say that'd be my main reason to pass on Go, even when the concurrency paradigm fits the project perfectly.
Earlier quoted context omitted.
latency and throughput (when with Java the system is crying for more memory while it's chilling in the Rust case)
You can tune java runtime in many ways, achieving impressive throughput/latency for your type of workload. Next to none of them will get you nearly as good cold start times as of native app, if using free java. There was GraalVM and its ecosystem which included Java Native Image - first thing I’d evaluate if thought about non-server side, performant Java application. But it all had been sadly swept away by Oracle fro…
But then it distributes as one binary and starts in milliseconds.
Rust would have been a better fit (cargo-and-done, smaller binary, quicker to compile); but I wanted to use Kotlin as we use in all other projects.
I understand the need for memory footprint in some situations, but what's the point of seeking performance for a software that mostly calls LLMs and waits?
Simplest explanation I could come up with: Just for hype and fun. Rewriting things in rust is "cool". Bun did it, other projects did it. Therefore, writing a coding agent in one should be cool too. And apparently enough HN crowd agrees with it to take the #1 spot on the board.
The author made the choice. Open sourced it (thanks!). So now we all enjoy more options. Saying author did so because "cool" does not sit well with me. It's feels like you get a no-strings attached gift of significant value and then going saying the giver gave it to be seen as cool.
Earlier quoted context omitted.
Aren't skills fairly easy to share, and can contain more than one file?
Prompts as well... he might be on to something here, can't say as I didn't try it yet Skills are just prompts
Earlier quoted context omitted.
What does the k stand for? Key? You can add any open Ai api endpoint you want, no?
No, you have to buy their subscription within the IDE
> Choose how AI runs by selecting built-in AI models from top-tier providers, bringing your own API keys or connecting local models.
And the AI Assistant in turn can use Junie.
At least that is what the plugin overview says, I have not tested it.
Earlier quoted context omitted.
Before I tried coding agents my guess would have been: none. But seeing how slow claude code and copilot cli are and how much ram they use I'm flabbergasted. If you have long running sessions they can both take tens pf gigabytes of ram and feel quite sluggish.
I've been playing with running Claude Code inside a Vagrant VM. I can't be certain it was getting OOM killed when I allowed the VM 4GB of RAM, but when I went to 16 it did seem to be more stable...
Of it's actually getting OOMed (and not backing off by itself), I'm pretty sure that's logged in dmesg. Or earlyoom or systemd-oomd if userspace is in play and getting there first.