Live data from Hacker News

Claude.ai unavailable and elevated errors on the API

status.claude.com

121–130 of 277 posts

Re: Claude.ai unavailable and elevated errors on the API

#121

The spend at my organization has reached beyond the $200,000 per month level on Anthropic's enterprise tier. The amount of outages we have had over these past few months are astounding and coupled with their horrendous support it has our executive team furious. its alot of money to be spending for a single 9 of reliablility.

Seems to be back now (claude code at least)

Re: Claude.ai unavailable and elevated errors on the API

#124
post #114

Earlier quoted context omitted.

It was pretty hard to justify the purchase to the board but we got a decent deal from a nearby data-center (~15% discount). Thankfully, it's fixed cost, its an asset we can use for our taxes, and it will survive for years to come. The only thing we have to work on is maintenance as well as looking into some renewable energy options. We're also looking into how to do some secure cost sharing with this so that all peop…

Sorry, didn't mean to be dismissive, I was just being a dickhead needlessly. I actually respect this a ton, good work.

It's fine! There's no world where individuals can buy this kind of stuff. Our company is too small to do it, but I'd love for there to be a public utility of sorts for being able to use LLMs. It is absurd that only these >$1T companies are allowed to run this. I also find it dangerous for society to have so much power and wealth concentrated there too.

Anyway, this is the internet and skepticism is warranted :D.

Re: Claude.ai unavailable and elevated errors on the API

#126
post #114

Earlier quoted context omitted.

Sorry, didn't mean to be dismissive, I was just being a dickhead needlessly. I actually respect this a ton, good work.

It's fine! There's no world where individuals can buy this kind of stuff. Our company is too small to do it, but I'd love for there to be a public utility of sorts for being able to use LLMs. It is absurd that only these >$1T companies are allowed to run this. I also find it dangerous for society to have so much power and wealth concentrated there too. Anyway, this is the internet and skepticism is warranted :D.

Yea, I actually looked into a similar thing myself recently. I was looking at how we could replace Cursor, and I found that for ~10 people we'd need a half dozen H100's or something on that scale, which would cost ~$1500 per developer or so to build and maintain on cloud infra, and to buy it would cost roughly 3 developers yearly salaries or so (this aligns with your numbers). We don't use that much inference, so we decided paying Cursor ~$200-300 per dev per month is better, for now, but in the future we might regret that when prices normalize more. However, we also don't use cloud agents or independent agents, we basically use AI as a pair programmer, so if we had to drop AI coding assistants completely our process wouldn't break too badly. I wish I could task my 3080 gaming card to do some inference, but I can only get ~10B models on there, so it's kinda worthless unless it's for something a small model can do.

Re: Claude.ai unavailable and elevated errors on the API

#127
post #70

Earlier quoted context omitted.

Why would Github be a guide? It's also terrible, but it's a radically different stack from an unrelated company

GitHub, along with MSFT in general, have massive copilot mandates where workers are being shamed into using slop tools to fix serious on-going issues. GitHub seems wholly incapable of resolving their issues: money isn't a problem, talent isn't a problem, but business leadership is definitely a major problem. Look at how other companies are suffering massive outages due to LLMs too like AWS and Cloudflare. Two compani…

None of the three major Cloudflare outages in the past six months had anything to do with LLMs. They were regular old human mistakes.

We did, however, determine that at least one of them (and perhaps all) would have been easily caught by AI code reviewers, had AI code reviewers been in use. So now we mandate that. And honestly, I love it, the AI reviewer spots all sorts of things that humans would probably miss.

(We also fixed a number of problems around configuration that would roll out globally too fast, leaving no time to notice errors and stop a bad rollout, as well as cases where services being down actually made it hard to revert the change... should be in a much better place now. But again, none of that had to do with LLMs.)

Re: Claude.ai unavailable and elevated errors on the API

#128

Earlier quoted context omitted.

Have you run a system in production? There are a multitude of reasons that a system can go down. There's no indication so far from Anthropic that this was merely compute limitations.

> There are a multitude of reasons that a system can go down. Start doing post mortems then! At the very least, them using any off the shelf service that's shitting the bed would inform others to stay away from it - like an IAM solution, or maybe a particular DB in a specific configuration backing whatever they've written, or a given architecture for a given scale. Right now it's completely like a black box that some…

I have no inside knowledge of Anthropic. But having done a lot of postmortems in general, one of the key dynamics that routinely comes up is "we know we keep shipping breakages, and we know these new procedures would prevent many of them, but then we wouldn't be able to deliver new stuff so quickly". Given where Anthropic is at and what they believe about the future of software development, that's a tradeoff that they may very well be intentionally not making.

Re: Claude.ai unavailable and elevated errors on the API

#129

Earlier quoted context omitted.

We are spending the equivalent of 32 monthly software engineer salaries on Claude per month.

Our expense is roughly around 12.3 software developers when you break it down across all people related expenses. But we've spent alot of time and energy prior to this focusing on our ability to measure our software development output across multiple teams. The delivery improvements are not evenly applied across all teams, but the increases that we have seen suggest a better ROI than if we had hired 12 developers.

I guess if you think about your teammates as purely inputs and outputs and not people that can improve and contribute in the workplace in other ways.

Re: Claude.ai unavailable and elevated errors on the API

#130

If this can happen to Anthropic, imagine all the companies building on top of Claude Code for live products. Hopefully the industry is learning that competent problem solving human engineers are still very much needed when you have increasingly deceptive non-deterministic genies running your production stack.

Maybe it will push companies to run them locally.

Haha, good one.
Post reply on HN