Personally using it for switching from and to locally served Gemma and Qwen endpoints.
Ask HN: What is your AI harness that lets you switch LLM models easily?
11–17 of 17 posts
Re: Ask HN: What is your AI harness that lets you switch LLM models easily?
#12I feel completely free to use any number of subscriptions alongside Claude. Nothing restricts me from utilizing LLM API keys or CLIs pinned to roles in the harness via config. However, that being said, I use this harness confident in using Anthropic models as my main model provider alongside other models (GPT*, GEMINI*, Cursor - Composer 2.5 etc) as more like workhorse models to spread/manage cost on large projects.
If cost is the underlying concern, then you might want to consider your actual cost associated with each task you run on your top frontier model. It might just be that not all of your tasks need to be sent to the most expensive model.
Re: Ask HN: What is your AI harness that lets you switch LLM models easily?
#13Re: Ask HN: What is your AI harness that lets you switch LLM models easily?
#14I built BitRouter(https://github.com/bitrouter/bitrouter), open-sourced, 0 markup for all models, free BYOK/subscription, and works with any harnesses out of the box