Live data from Hacker News

Ask HN: What is your AI harness that lets you switch LLM models easily?

news.ycombinator.com

11–17 of 17 posts

Re: Ask HN: What is your AI harness that lets you switch LLM models easily?

#11
Pi (https://pi.dev), a TUI based harness, lets you easily cycle through all configured models through the keybindings CTRL+P (forward) and SHIFT+CTRL+P (backwards).

Personally using it for switching from and to locally served Gemma and Qwen endpoints.

Re: Ask HN: What is your AI harness that lets you switch LLM models easily?

#12
Hmm, I honestly think a harness should be more about workflow, control, ease of use, memory optimization...other things I can't think of right now, the model/subscription being the least of them. Most of my experience has come from using Claude Code so I can only speak from that, but I will at some point pick up 'Pi' when I'm feeling adventurous.

I feel completely free to use any number of subscriptions alongside Claude. Nothing restricts me from utilizing LLM API keys or CLIs pinned to roles in the harness via config. However, that being said, I use this harness confident in using Anthropic models as my main model provider alongside other models (GPT*, GEMINI*, Cursor - Composer 2.5 etc) as more like workhorse models to spread/manage cost on large projects.

If cost is the underlying concern, then you might want to consider your actual cost associated with each task you run on your top frontier model. It might just be that not all of your tasks need to be sent to the most expensive model.

Re: Ask HN: What is your AI harness that lets you switch LLM models easily?

#14
I would recommend just connect your whatever you used or built to a LLM gateway & router to use any models without management complexity.

I built BitRouter(https://github.com/bitrouter/bitrouter), open-sourced, 0 markup for all models, free BYOK/subscription, and works with any harnesses out of the box

Post reply on HN