Live data from Hacker News

Portal by Spotify cut my Claude Code token usage by 90%

engineering.atspotify.com

71–80 of 183 posts

Re: Portal by Spotify cut my Claude Code token usage by 90%

#74

So this is just delegating certain work to dumber models? I certainly wouldn't use Gemini 2.5 Flash (!!?) for code writing as suggested. I've never had an issue with Codex or Claude reading massive files, they're really good at precise greps.

I wish I could say this explains a lot about the state of Spotify's apps, but they have been that way since long before AI.

Re: Portal by Spotify cut my Claude Code token usage by 90%

#75
post #18

Earlier quoted context omitted.

> I've never had an issue with Codex or Claude reading massive files Reading files isn't a problem they want to solve. The idea seems to be using a cheaper model to "scout" for the intended code, instead of an expensive one that reads all the things (and spends more tokens / thinks about them). I think this might be useful because Opus 5 especially tends to over-read. So this looks like an "LLM Bloom filter", telling…

> "LLM Bloom filter" very good way to put it.

It's not a great analogy, since Bloom filters are guaranteed to not have any false negatives, only false positives.

That property would be very useful here, but I don't see how it would be achievable using LLMs.

Re: Portal by Spotify cut my Claude Code token usage by 90%

#76
post #67
post #46

Earlier quoted context omitted.

As of July, the explore agent inherits the parent model, capped at opus. So fable and opus use opus to explore. Sonnet uses sonnet. I replaced my built in explore agent with one hardcoded to sonnet low effort. https://github.com/anthropics/claude-code/issues/72940

It did used to use Haiku but that model is now too too far behind…

[deleted]

Re: Portal by Spotify cut my Claude Code token usage by 90%

#77

So this is just delegating certain work to dumber models? I certainly wouldn't use Gemini 2.5 Flash (!!?) for code writing as suggested. I've never had an issue with Codex or Claude reading massive files, they're really good at precise greps.

Am I missing something? Unless you have infinity money, would it not be very stupid to pay for "precise greps?"
Post reply on HN