Viewing profile — apitman

> OpenCode Go currently offers $120 for $10 on DeepSeek Flash v4 At DeepSeek's absurdly low rates or market rates?

I'm getting like 25 tok/s on 2x RTX Pro 6000. This is with llama.cpp, but I had GPT tune it for me. I was under the impression vLLM was at most ~2x faster, and usually for highly p…

These are very interesting results, and honestly hard to believe, even as a big 0731 fan. If I'm reading the chart correctly, a couple observations: * deepseek-v4-flash-0731 max is…

I've found it to be pretty good so far.

DeepSeek has far cheaper cache pricing. That's the difference.

These numbers look about right based on my experiences as well. Though for a single user I think 2x DGX Spark (~$10k) runs DSv4 Flash fairly well right?

Welp. That didn't last long

As low as it is, switching between providers on OpenRouter is still lower. That said, it's a fair point. For me, it boils down to things covered here: https://earendil.com/posts/se…

Looks like coding agent is model+harness. There are far fewer models represented on that page. I believe "agentic index" is still the metric to look at for coding performance. I co…

For one thing, providers of open models can't arbitrarily increase their prices without facing competition.

If your coding agent workflow isn't sandboxed, backed up, and rollback-able, it's fundamentally broken. And yes I realize most of us aren't working this way today. But I think we'l…

Oh are you saying the human remains the bottleneck?

I don't doubt this is true for many projects currently (though it's not for a bevy project I'm working on). Have you tried Cerebras, Groq, Taalas, et al? It was a paradigm shift fo…

I could see Rust becoming the language for coding agents, because it has such solid guardrails built in. I could also see it slipping into obscurity as LLMs get faster and compile …

I grew up on Dune lore and the first movie is one of my favorites of all time. Highly recommended for any Dune fan. I didn't care for the second one.

Can you give some more details on the technical differences between completions and responses that people actually care about? I found this information surprisingly hard to drum up…

I'm sure you were referring to the desktop app but codex CLI is open source

Would love to have this on https://github.com/anderspitman/awesome-tunneling as soon as it hits 100 stars.

Wow this thing just blew out the pareto front for intelligence/$

See Cerebras and Groq as well.

Speed is the metric I'm currently most interested in. The models are smart enough. Once speed significantly increases I think we're going to see some interesting downstream effects…

That's surprising. Does it have no sub agent support at all or does it just use the same agent as the parent?

> The way to solve for this is to have them work on two different worktrees with separate environments, ports What are you using for the environment part? Containers?