Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Claude-thermos keeps your Claude session warm for you

github.com

Post reply on HN
Print view View original

11–20 of 91 posts

Re: Show HN: Claude-thermos keeps your Claude session warm for you

#13

Post by cadamsdotcom »

agluszak wrote: post #5
l1n wrote: post #3

Earlier quoted context omitted.

Why? Seems fine if people want to burn more cache reads.

Because it makes Anthropic earn less money

"Earn"?

Cache duration is arbitrary. What it actually does (if used en masse) is decrease the amount of oversubscription their infra can handle..

Re: Show HN: Claude-thermos keeps your Claude session warm for you

#14

Post by s0ck_r4w »

jonas21 wrote: post #7

Is the 5-minute expiration correct? I thought it was more like ~1 hour.

You can set the retention globally (whole session) to 1 hour which will actually make it more expensive. The default is 5 minutes.

*UPD:* actually it appears the default is authentication-dependent. API key gets 5 minutes, subscriptions - 1 hour.

Re: Show HN: Claude-thermos keeps your Claude session warm for you

#18

Post by s0ck_r4w »

unholiness wrote: post #10

I've directly inspected calls for pro/Max plans and as of today they have 1hr cache expiries. This has definitely degraded to 5 min in the past but that's the behavior today. If you're paying API rates, you can choose 5m or 1hr yourself (and pay different rates). Keeping a 1hr cache warm could still be useful, sure, but outside that, I don't see much use of this today.

When using API keys the default is still 5 minutes. Setting 1 hour for the entire session is actually a lot more wasteful considering the 2x rate that it comes with
Post reply on HN