I generally believe the proxy route is best to understand any harness. I been building some thing similar.
Show HN: Smart model routing directly in Claude, Codex and Cursor
111–120 of 127 posts
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#112Earlier quoted context omitted.
If you have a Claude sub with subsidized usage we use that. If not you pay API prices.
Is that because you start by running it inside Claude Code? I don't see how Claude would allow any other harness to call them for their subscription, after all that OpenClaw hullabaloo.
Yep exactly
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#113Earlier quoted context omitted.
I would argue they do not have a good incentive to build this and make it better. Why would Anthropic route Claude Code traffic to DeepSeek (at 20% of the cost)?
They'll route traffic to Haiku or one of their cheaper models, not third parties. Overall cost will end up being cheaper than whatever you are doing
We welcome the competition :)
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#114I ran into a problem at work recently: we are given access to a bunch of models up to a full Claude Opus 4.8, but a monthly budget of 100k tokens. We are also given access to Gemini 3.5 Flash & 3.1 Pro with a daily budget of 50M tokens, but no tool calling. I'd love to hook Claude Code (or Pi) into the Gemini model, but the lack of tool-calling makes it quite difficult. I've been planning out how an intelligent route…
Yes we can route to Gemini models too and we handle all the translation complexity there!
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#115This would have been neat back when I could afford enough tokens to even set it up properly. Now I’ve had to increase my GH Copilot subscription just to cover the bare minimum updates to a few websites every month, and I no longer do any test driving, or even recreational coding projects. I don’t have hundreds of dollars a month to plow into these products, so I’m rationing use, looking for better local options, and…
I've been building a reasonably complicated project over the past week using deepseek v4 pro almost exclusively (a couple of k2.7 and 1 session with gpt5.5 to re-assess some architectural questions). Deepseek is super capable though if you're a coder. I don't even write "code" but I can tell when it's doing something dumb and tell it how to do it better, but other than that I'm not micro managing it or using it "just…
Yes the open source models are very good, that’s a big part of what makes this router save so much money in practice! There definitely are some things they still don’t handle well though where you do want a frontier model
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#116Just curious how the router decides on which model to use. When I use Claude Code, I often ask Claude Code to decide itself if it should spawn a sub-agent to downgrade or upgrade the model. Claude Code is smart to know how much context and cache it has and will decide if it should use sub-agent with a lesser model (sometimes it costs more to re-fetch tokens with a Sonnet sub-agent if the parent agent already has the…
We trained a model to select which LLM to call at any given turn, based on lots of agent traces
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#117I see a great tension in the market today. On one hand you want agents to work reliably and that needs a lot of harness, computer use, model routine, tasks running longer etc. And on other hand you simply want to reduce your dependencies and costs.
Agent building is very nascent and all the frontier companies are trying to build the best harnesses possible.
As basic prompting, researching, coding gets mature, more and more of such tasks will be optimal for model routing open source etc etc but there is a chance that by that time frontier models again make costs and routing, low and effortless.
Basically I believe everyone has started jumping to the. -- REAL PROBLEM IS COST v. REAL PROBLEM IS EFFICIENT, RELIABLE AGENTS/WORKFLOWS.
It's going to be very interesting to see how this plays out.
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#118This might be a stupid question, but can a extra added local llm help with the caching problem?
We haven't experimented with routing to local LLMs much. Technically they benefit from the cache too although it's more a question of latency than cost. But tbh I haven't seen great results in the wild from working with local LLMs for coding - curious if you've had any success with them?
I generally used them for token saving purposes, just using them for repetitive tasks, gated and supervised by claude. So its planned and verified by better models, but implementation falls on local ones. It has been pretty effective for me, as long as I spend a bit more initially on splitting complex tasks further down
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#119What I want is a router that can also provision compute on demand and shut it down when it is done.
Re: Show HN: Smart model routing directly in Claude, Codex and Cursor
#120[flagged]