Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

github.com

Post reply on HN
Print view View original

81–90 of 97 posts

Re: Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

#81

Post by Cpoll »

hansvm wrote: post #55
onlyrealcuzzo wrote: post #34

Earlier quoted context omitted.

None of these tools measure how effective they are... It's a massive red flag to me when you could get decent data to see if your thing actually works, and they don't even attempt to... Have the LLM use your tool, run it on several of the coding benchmarks. If you're stingy, run it on the ones that don't cost much. Otherwise, I'm going to assume it doesn't actually work. If it did - Claude, Antigravity, Codex, Pi, or…

> otherwise, popular solutions would integrate the idea None of the major players are incentivized to care about this, especially not over other opportunities. Why would you expect them to integrate it? One of the biggest wins you can institute for your own codebase if you use agents is writing your own harness, by a huge margin. The defaults are fine, but you can do better.

They're incentivised because they're offering plans at a loss and/or pricing out potential customers. All these LLM companies are competing on accuracy and price.

Re: Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

#83

Post by Bnjoroge »

hboon wrote: post #59
onlyrealcuzzo wrote: post #58

Earlier quoted context omitted.

> The defaults are fine, but you can do better. Why can I do better than Pi? I don't want to build my own harness and deal with the bugs... I want to build my project... My understanding is that Codex / Claude / Gemini subscriptions don't work with custom harnesses. It's pretty hard to beat 5x more usage if you have the $200/mo subscription by using the API instead.

Codex definitely does and Claude Max definitely doesn’t.

definitely doesnt is a strong word. it technically is possible, but you might get banned

Re: Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

#84

Post by threecheese »

zdkaster wrote: post #18
threecheese wrote: post #10

The docs are missing any examples of what this does, instead showing _how_ it works - and only for the codebase itself, rather than the behavior of the app. What would be useful: - examples of text that can be filtered, and why that would be valuable - a data flow diagram of runtime behavior, showing how filtering removes unnecessary context

Thanks for your feedback. Will put this in place. Meanwhile, please checkout architecture doc and plugin. The plugin doc could a little bit giving insight of what it does.

[dead]

Re: Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

#86

Post by hboon »

Bnjoroge wrote: post #83
hboon wrote: post #59

Earlier quoted context omitted.

Codex definitely does and Claude Max definitely doesn’t.

definitely doesnt is a strong word. it technically is possible, but you might get banned

That was true. But actually, I think that's changed a few weeks ago since they introduced a API credit amount equivalent to your (eg. $100, $200) that will be used for such cases. So they don't ban you, they just bill you that allocated credit and then actual API cost.
Post reply on HN