I have been using this : https://magnitude.dev/ for a while now. Is it something similar you are doing? I would love to have something that would connect to my codex, Claude, and opencode subscription rather than having to make a new subscription.
Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
61–70 of 254 posts
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#62Earlier quoted context omitted.
This is what OpenAI and Anthropic are trying to make everyone believe. Most accountants will flinch at this (they already are). The $200 odd plans are already out of reach of many, many people. The attrition of customers if they were to get rid of these subscriptions plans would be untenable.
I think you are looking at it incorrectly. No business is buying individual accounts, because if they do, they open themselves up to considerable risk. The $200 plans are priced so that the power-users use them and then advocate about how great the product is. If you're buying a $200 plan, you're not doing it because of the price point but rather because of the amount of work it is doing for you.
Lots of businesses are buying and using these plans. Basically every small business I interact with.
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#63So this is the dogpile.com of the askjeeves, alta vista, and lycos approach? Time is a flat circle?
Mixture of Models, perhaps? tbf to OP, the setup they're proposing has also been recently evangelized by other "ai gateway" products (like OpenRouter, JusCode, Fireworks etc), so there's likely something useful here.
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#64This reminds me on OpenRouters report that combining multiple different models gave comparable performance to Fable 5. I think this approach has lots of potential. Maybe OpenAi was ahead of its time with GPT-5 (it being a router to different models rather than just being one new model)
You might be interested in a project that I'm working on, which is kind of like OpenRouter Fusion, but instead of waiting for all models to synthesize, we stream the best model immediately and background the rest. The background models then reconcile with an emoji reaction and optional reply. It gets similar results to Fusion and is a lot faster! There's a free version that leverages open weight models here: http://p…
I like that I was able to test without an account and my prompt (What's the feasibility of a NetNavi IRL, along with a PErsonal Terminal? Create a document that outlines how to make this happen.) makes me think Pellmell is gonna be a research tool I'll continue to use.
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#65No benchmarks, no info on which models are used, ai generated video, just a signup page with nothing else. Anyhow, this kinda reminds me of that quote about architecture: "We replaced our monolith with micro services so that every outage could be more like a murder mystery."
It's basically trying to replicate OpenRouter, which works pretty well and has a lot of nice features to abstract away any single provider, such as failover, metering, autoswitching, etc. It's actually a really smart infrastructure abstraction. I just wish this were solving an actual problem rather than being a fairly transparent attempt to say something approximating, "Hey VCs, OpenRouter just became a unicorn but I…
It feels a bit more like Fugu to me, which acts as a multi-LLM orchestrator (though I think Fugu combines open- and closed-weight models), but without being able to see the “secret sauce” behind how any of them decides the number of "plies" each model in the swarm gets, they all feel rather difficult to compare beyond the big public benchmarks...
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#66So the word security or any topic related to it is mentioned and it flips to an older gen model? Fable is nearly useless now it you do anything around auth.
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#67So this is the dogpile.com of the askjeeves, alta vista, and lycos approach? Time is a flat circle?
Mixture of Models , perhaps? tbf to OP, the setup they're proposing has also been recently evangelized by other "ai gateway" products (like OpenRouter, JusCode, Fireworks etc), so there's likely something useful here.
Ensemble Methods:
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#68Seems similar to Openrouter Fusion - https://openrouter.ai/docs/guides/routing/routers/fusion-rou...
Fusion is a totally different approach, though similar in the sense that it leverages different models.
Fusion generates many replies then synthesizes. This adds a ton of latency and cost, so it's going to be better only for cases where you're willing to wait a lot and pay a lot more.
Routers (like this project) are a different thing, they can theoretically improve performance and cost at the same time without increasing latency much. I'm a bit skeptical though, since knowing which LLM is going to be better on a cost adjusted basis is hard (see https://artificialanalysis.ai/models/capabilities/coding?cos..., where the cost per task vs. performance is not what you expect, for example comparing Qwen 3.7 Max to GPT Sol.
A project I'm working on is aimed at improving performance without added latency but from a different angle. Instead of waiting for all replies for synthesis (like OpenRouter Fusion), it streams the "best" reply immediately (using a router to pick the best model) then synthesizes with emoji reactions and optional replies from the background models. It's free to use here with no login: http://pellmell.ai
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#69So the word security or any topic related to it is mentioned and it flips to an older gen model? Fable is nearly useless now it you do anything around auth.
I can get it to write win32 unsafe rust code.
I can't get it to review win32 unsafe rust code.
Make it make sense.
Re: Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
#70Earlier quoted context omitted.
In MoE systems the routing decision is made per-token, not per prompt or task. It’s one of ML’s many confusing naming conventions. Even more confusingly, there are older pre-LLM MoE systems which ensemble and pool the predictions from multiple sub-components. For example in a random forest you could take the majority vote of the decision trees or the average of their numerical predictions. After that, we developed ne…
"In MoE systems the routing decision is made per-token, not per prompt or task." Have there been experiments with doing it per task? Like, "oh this is python project, use this model" "oh this is about writing fantasy, use this"?
It’s a good idea. The results probably depend a lot on how close your task is to the benchmarks though.
I think OpenAI already has (had?) a feature like this called “auto” mode for thinking.