Live data from Hacker News

Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

github.com

401–410 of 695 posts

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#401

Earlier quoted context omitted.

Man, expecting the minimal from companies who are supposed to deliver a pro... there is no SLA for any this, so you are right. Also, why is there no SLA?

because there isn't one and people still paid for it. My clients demand one, so there is one.

Imagine if people were like your clients.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#402

Earlier quoted context omitted.

Because this is ultimately a beta service. The whole industry is.

Wait, where is there a 'beta' tag to something that they are charging real money for? Why is this software any different than any other software and we should completely give away our rights as a consumer to ensure what we pay for is delivered?

I think the parent is saying that one should be aware that the whole LLM industry is still in an experimental stage and far from mature. What you want isn’t what’s being offered. I agree that there should be higher standards, but what we currently have is an arms race. The consequence is to factor that into the value proposition and maybe not rely too much on it.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#403

Earlier quoted context omitted.

An enforceable SLA with the services that Anthropic offers rather than putting an employee to respond to things on Sunday.

Then you should offer to pay them for one. I’m sure they’d love to hear from you, and they could probably deliver one to you for the right price. But it will be a high price.

They don't offer a ZDR [0] for files, even if you have a BAA or dealing with HIPAA data, no matter how much you pay them. Trust me, we have tried.

[0] https://code.claude.com/docs/en/zero-data-retention

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#404

Hey all, Boris from the Claude Code team here. We've been investigating these reports, and a few of the top issues we've found are: 1. Prompt cache misses when using 1M token context window are expensive. Since Claude Code uses a 1 hour prompt cache window for the main agent, if you leave your computer for over an hour then continue a stale session, it's often a full cache miss. To improve this, we have shipped a few…

> defaulting to 400k context instead, with an option to configure your context window to up to 1M if preferred

This seems really useful!

I'm surprised that "Opus 4.6" (200K) and "Opus 4.6 1M" are the only Opus options in the desktop app, whereas in the CLI/TUI app you don't seem to even get that distinction.

I bet that for a lot of folks something like 400k, 600k or 800k would work as better defaults, based on whatever task they want to work on.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#405

Hey all, Boris from the Claude Code team here. We've been investigating these reports, and a few of the top issues we've found are: 1. Prompt cache misses when using 1M token context window are expensive. Since Claude Code uses a 1 hour prompt cache window for the main agent, if you leave your computer for over an hour then continue a stale session, it's often a full cache miss. To improve this, we have shipped a few…

Resizing the context window seems like a very good idea to me. I noticed a decline of productivity when the 1M context window was released and I'd like to bring it back to 200k, because it was totally fine for the things I was working on.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#406
Been running into the same issue since a week or 2 ago on Opus.

To be fair I have a pretty loose harness and pattern but it’s been enough to pull in 20k in bounties a month for a long time without going over plan with very little steering (sometimes days of continuous work)

That being said I’ve figured this was coming for a long time and have been slowly moving to local models. They’re slower but with the right harnesses and setup they’re still finding much the same amount in bounties.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#407

Earlier quoted context omitted.

That might be, but the argument was that poor cache utilization was costing Anthropic too much money in other harnesses. If cache is considered in rate limits, it doesn’t matter from a cost perspective, you’ll just hit your rate limits faster in other harnesses that don’t try to cache optimize.

There were two issues with some other 3p harnesses: 1. Poor cache utilization. I put up a few PRs to fix these in OpenClaw, but the problem is their users update to new versions very slowly, so the vast majority of requests continued to use cache inefficiently. 2. Spiky traffic. A number of these harnesses use un-jittered cron, straining services due to weird traffic shape. Same problem -- it's patched, but users upg…

If you give doll a list of things you want to see from third party harnesses, a compliance checklist it will make sure the one it is building follows it to the letter.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#408

Earlier quoted context omitted.

Wait, where is there a 'beta' tag to something that they are charging real money for? Why is this software any different than any other software and we should completely give away our rights as a consumer to ensure what we pay for is delivered?

What right as a consumer do you have that is pertinent here, other than to have the vendor adhere to the terms of the agreement you have with them? Anthropic has many customers despite the fact that they have occasional problems. They’re not suing Anthropic because Anthropic isn’t promising in its agreement something they can’t deliver. I think you’re reading into the agreement something that isn’t there, and that’s…

I am not reading into an agreement, I am saying there is no agreement to be found to ensure service delivery and the associated liability that would come for any SLA. Also, where is the Anthorpic SLA for Enterprise?

Does it exist?

Just because people pay for things doesn't mean they know or understand what they are paying for. Nor is there the legal precedence to actually understand where the rub lies or how that impacts business.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#409

Earlier quoted context omitted.

> 1hr -> 5min on March 6th This is not accurate. The main agent typically uses a 1h cache (except for API customers, which can enable 1h but it is not on by default because it costs more). Sub-agents typically use a 5m cache.

So if I run a test suite or compile my rust program in a sub agent I’m going to get cache misses? Boo.

Sub agents don't have much context and don't stay around for long, so misses in that case are trivial.

Re: Pro Max 5x quota exhausted in 1.5 hours despite moderate usage

#410
post #111

Earlier quoted context omitted.

The evidence is that quotas exist, as seen here, and are low enough that people are hitting them regularly. When was the last time you hit your quota of Google searches? When was the last time you hit your quota of StackOverflow questions? When was the last time you hit your quota of YouTube videos? Any service will rate limit abuse, but if abuse is indistinguishable from regular use from the provider's perspective,…

Great point. The parent's argument is that the marginal cost of inference is minimal. However, the fundamental flaw is that he's separating inference from the high cost frontier models. It's a cross-subsidy that can't be ignored.

Without any insider knowledge on the economics of these companies, I suspect it's that the amount of infrastructure you have to build is determined by peak usage rather than average usage. If peak usage is much higher for a small part of one day a week (say on Monday morning as software developers across the US get back to work) the cost of fulfilling demand at all times can be insane. That's why companies are implementing batch/standard/priority pricing for the API.
Post reply on HN