Viewing profile — jarodrh

True, but human review isn't visible in the logs, hmm, however I suppose retry patterns can, but frugon doesn't currently track this, so we can't quantify this yet. Frugon analyzes…

> As well. Someday costed opcodes and sharded redundancy for all of this; Hmm, noted. > If an algorithm selects according to rank, there's a cost/score/fitness/survival/error funct…

Down the rabbit hole we go. > Is this a convex optimization or non-convex optimization problem? - Neither, frugon sidesteps that issue by having a small finite candidate selection …

Very interesting thoughts. This is a whole discussion on its own. The ones that I mulled over that I feel have legs in my line of thinking are: > minimize cost to converge upon suf…

Yes they do, it's quite the popular topic atm. RouteLLM (OSS - frugon's savings bands are based on their research), OpenRouter's auto mode; I actually commented on a /show post not…

Thanks. Yes, local models are gaining a lot of traction. The measure/judge step uses LiteLLM, so it does sample local models. I just tested "--candidates ollama/llama3.2:1b", and t…

Interesting project. Most of what I read appears to deal well with a linear agent session. How does it handle concurrent agent/subagent spawning? Do they fall under the same sessio…

Thanks. I'm not sure if you're asking "how does frugon compare provider models" or "can it compare across provider models" or even "how does frugon compare to other tools"... On th…

You got cut off at the end, but I hear your point. I completely agree that cost-per-successful-outcome is the goal, and "cheapest" is never the entire solution, but only routing to…

Thanks. Yes, that's exactly right, and aptly named so in the code. A few things to note: the prompt is actually deliberately tie-biased; the tie only then breaks on clear material …

That's an interesting thought, and one I'll take note of, but that would be a different tool. However, if you look hard enough I'd say we're tackling the same issue. I'm just choos…

Thanks! I love a good meaningful name Frugal + on :P

We've all been there where we choose the easy least efficient route just cuz (laziness...can afford it), but we've mostly done this consciously. The example in the article however …

Hmm, I honestly think a harness should be more about workflow, control, ease of use, memory optimization...other things I can't think of right now, the model/subscription being the…

I started leaning in on AI heavily this year, as I wanted to get more done autonomously, but then my token usage climbed dramatically to the point where my weekly quota would run o…

The article's own example makes the point I'm about to make: > To give an example, just doing Typescript type fixes with this model across 50 files cost me $54 this afternoon. That…

reactordev pretty much got it right. In the config, you say "this role uses this model". You decide up front which model handles which kind of task, instead of one model doing ever…

Orchestration works very well for me, but not in the way most people seem to be pushing for, with middlemen scoring and routing every request. For coding, the routing is mostly sol…

[dead]

Interesting. Read through the comments and the cache issues and context loss issues were already mentioned and they are all good valid points. I'll go from the positive side. I thi…

[flagged]