Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

github.com

Post reply on HN
Print view View original

631–640 of 695 posts

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#631

Post by FuckButtons »

steveBK123 wrote: post #611
pu_pe wrote: post #589

Earlier quoted context omitted.

So Anthropic is trying to save money on infrastructure, we all get it. However, it's not ok to degrade the performance your users have paid for. Last week the issue was that you reduced the default "effort" level, now the prompt cache is shortened. Several users experience far more restrictive usage limits lately. There is only so much you can do through "UX improvements" or some smart routing on the backend. Your fl…

Classic VC pump playbook - run it uneconomically until everyone is addicted, then 5x prices once you have enough critical mass. See 2010s "Millennial Lifestyle Subsidy"..

It seems pretty transparent that they are heavily resource constrained, (training run for Claude 5.x, higher usage / growth than anticipated). I don’t disagree that their long play is monopolistic pricing, but what we’re observing seems better explained by the fact they have a very tight compute budget they are trying to optimize over to put as much as they can into next gen experiments / training to make sure they stay competitive over the next 6-months / year.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#632

Post by visarga »

davmre wrote: post #496
yumraj wrote: post #487

Earlier quoted context omitted.

Where are you getting 60GB from? It shouldn’t be that large. But yes, would love to save context/cache such that it can be played back/referred to if needed. /compact is a little black box that I just have to trust that is keeping the important bits.

The KV cache consists of activation vectors for every attention head at every layer of the model for every token, so it gets quite large. ChatGPT also estimates 60-100GB for full token context of an Opus-sized model: https://chatgpt.com/share/69dc5030-268c-83e8-92c2-6cef962dc5...

There are ways to quantize or compress KV cache down.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#633

Post by visarga »

taspeotis wrote: post #506
bcherny wrote: post #210

Hey all, Boris from the Claude Code team here. We've been investigating these reports, and a few of the top issues we've found are: 1. Prompt cache misses when using 1M token context window are expensive. Since Claude Code uses a 1 hour prompt cache window for the main agent, if you leave your computer for over an hour then continue a stale session, it's often a full cache miss. To improve this, we have shipped a few…

Hi, thanks for Claude Code. I was wondering though if you'd considering adding a mode to make text green and characters come down from the top of the screen individually, like in The Matrix?

No, I want a little monkey doing tricks. /s

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#634

Post by visarga »

MuffinFlavored wrote: post #373
bcherny wrote: post #210

Hey all, Boris from the Claude Code team here. We've been investigating these reports, and a few of the top issues we've found are: 1. Prompt cache misses when using 1M token context window are expensive. Since Claude Code uses a 1 hour prompt cache window for the main agent, if you leave your computer for over an hour then continue a stale session, it's often a full cache miss. To improve this, we have shipped a few…

I wish people would pay more attention to: * Anthropic is in some way trying to run a business (not a charity) and at least (eventually?) make money and not subsidize usage forever * "What a steal/good deal" the $100-$200/mo plans are compared to if they had to pay for raw API usage and less on "how dare you reserve the right to tweak the generous usage patterns you open-ended-ly gave us, we are owed something!"

yes, $200/mo is a serious subscription, we are owed something, and I won't feel ashamed for saying that

especially when you are told using the subagent for code review "claude -p" is now billed on API on top of $200 sub

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#635

Post by cyrusmg »

chandureddyvari wrote: post #40

Claude has gotten noticeably worse for me too. It goes into long exploration loops for 5+ minutes even when I point it to the exact files to inspect. Then 30 minutes later I hit session limits. Three sessions like that in a day, and suddenly 25% of the weekly limit is gone. I ended up buying the $100 Codex plan. So far it has been much more generous with usage and more accurate than Claude for the kind of work I do.…

I also gave up on my Claude Code subscription. It's running out in 2 weeks and I have canceled it. My current MAX session got rate-limited in 2 hours of work and that's just absurd.

Codex seems to give the $20 plan for free for 1 month and that's what I signed up for.

Let's see how it compares when I can't use my Claude max sub for 3 more hours.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#636

Post by stingraycharles »

rimliu wrote: post #614
stingraycharles wrote: post #583

Earlier quoted context omitted.

This comment seems unnecessarily hostile.

Do you really want HN by like Stepford Wives? Dang is already doing to good job on closing on that, no need to encourage them more.

The original poster edited his comment after my response, it was far more hostile before. So I assume my input worked.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#637

Post by naasking »

danmaz74 wrote: post #377
SkyPuncher wrote: post #125

I skimmed the issue. No wonder Anthropic closes these tickets out without much action. That’s just a wall of AI garbage. Here’s what I’ve done to mostly fix my usage issues: * Turn on max thinking on every session. It save tokens overall because I’m not correcting it of having it waste energy on dead paths. * keep active sessions active. It seems like caches are expiring after ~5 minutes (especially during peak usage…

> This is the most frustrating thing because Anthropic forced the 1M model on everyone. This is spot on. It would be great (and very easy for them) to have a setting where you can force compaction at a much lower value, eg 300k tokens.

CLAUDE_CODE_AUTO_COMPACT_WINDOW=400000

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#638

Post by miroljub »

bcherny wrote: post #210

Hey all, Boris from the Claude Code team here. We've been investigating these reports, and a few of the top issues we've found are: 1. Prompt cache misses when using 1M token context window are expensive. Since Claude Code uses a 1 hour prompt cache window for the main agent, if you leave your computer for over an hour then continue a stale session, it's often a full cache miss. To improve this, we have shipped a few…

People, just switch to MiniMax and ditch CC completely. It's not worth it any more.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#639

Post by mrbungie »

KptMarchewa wrote: post #623
Toutouxc wrote: post #596

Earlier quoted context omitted.

The idea is that Claude Code is surprisingly buggy and unrefined for something created by the very tool and processes that are supposed to be replacing us as we speak.

The idea is that sculpted ideal code is rarely the best choice.

At the same time I'd say sloppy code (human or AI generated) is rarely the best choice. I'd say the best is in between.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#640

Post by lukan »

visarga wrote: post #625
zachrip wrote: post #622

Earlier quoted context omitted.

Where did they say the prompt cache is shortened?

from 1h to 5 minutes, was in the news recently

But not as a solid fact?

The HN thread in question is here (and had that info edited out of the title)

https://news.ycombinator.com/item?id=47736476

Post reply on HN