Earlier quoted context omitted.
Remember when OpenAI wasn’t allowing new subscriptions to their ChatGPT pro plans because they were oversubscribed? Pepperidge Farms remembers.
Wouldn't that be good? I remember back in the day you could only get Gmail thru an invite, it was an awesome strategy. "Currently closed for applications" creates FOMO. They'd just need to actually get the GPUs in relatively short supply. They could do it in bursts though, right? "Now accepting applications for a short time." I'm not an internet marketer but that sounds like a win win to me. People feel special, they…
Elevated errors on Claude.ai, API, Claude Code
131–140 of 241 posts
Re: Elevated errors on Claude.ai, API, Claude Code
#132Earlier quoted context omitted.
US Pacific comes online while London is still working and they can't handle it. $380bn valuation btw.
No amount of valuation can fix global supply issues for GPUs for inference unfortunately. I suspect they're highly oversubscribed, thus the reason why we're seeing them do other things to cut down on inference cost (ie changing their default thinking length).
Re: Elevated errors on Claude.ai, API, Claude Code
#133In the past few weeks: - Anthropic introduced stringent limits at peak hours. By "introduced" I mean announced it on a random dev's Xitter account - Users suddenly started burning through all of their tokens even on trivial tasks. Anthropic never truly acknowledged it, their random devs posted "we're working on it". - One of the workarounds was to somewhat quietly reduce default reasoning to medium - OpenClaw and "us…
Re: Elevated errors on Claude.ai, API, Claude Code
#134Once AGI is achieved, they'll reach the fabled superhuman "two nines" of uptime.
Re: Elevated errors on Claude.ai, API, Claude Code
#135Earlier quoted context omitted.
No amount of valuation can fix global supply issues for GPUs for inference unfortunately. I suspect they're highly oversubscribed, thus the reason why we're seeing them do other things to cut down on inference cost (ie changing their default thinking length).
maybe, but the response to GPU shortages being increased error rates is the concern imo. they could implement queuing or delayed response times. it's been long enough that they've had plenty of time to implement things like this, at least on their web-ui where they have full control. instead it still just errors with no further information.
Engineer roles dead in 6 months.
Re: Elevated errors on Claude.ai, API, Claude Code
#136I think a cheat code here is to route your requests to GCP's Vertex AI, which has stronger uptimes. Can use it as a fallback or main provider. Caveats: 1) May not be economic for those on flat-rate Anthropic subscription plans 2) I work at Google.
Re: Elevated errors on Claude.ai, API, Claude Code
#137This is why I keep a z.ai subscription as a backup.
Re: Elevated errors on Claude.ai, API, Claude Code
#138Earlier quoted context omitted.
Remember when OpenAI wasn’t allowing new subscriptions to their ChatGPT pro plans because they were oversubscribed? Pepperidge Farms remembers.
Wouldn't that be good? I remember back in the day you could only get Gmail thru an invite, it was an awesome strategy. "Currently closed for applications" creates FOMO. They'd just need to actually get the GPUs in relatively short supply. They could do it in bursts though, right? "Now accepting applications for a short time." I'm not an internet marketer but that sounds like a win win to me. People feel special, they…
In the case of Anthropic is fake availability.
Sam Altman explained the idea is to scale the thing up, and see what happens.
He hadn't claimed to offer a solution to the supply problem that would unfold.
Re: Elevated errors on Claude.ai, API, Claude Code
#139Coding is solved
Nothing to do with coding and everything to do with capacity. In fact, this proves that there is no AI Bubble and we are massively capacity constrained (aka we under-invested in infrastructure)
Re: Elevated errors on Claude.ai, API, Claude Code
#140Have anyone found good techniques to get a session out of Claude Code, so that I can point another tool at it and pick up there? This always seems to happen at the worst possible time, after having spent an hour getting deep into something – half finished edits across files, subagents running, etc.