as an anecdote of support for yaw terminal i am currently logged in via Yaw Mode and have been continuing to use claude all day no problems while the browser is absolutely unavailable.
Claude.ai unavailable and elevated errors on the API
191–200 of 277 posts
Re: Claude.ai unavailable and elevated errors on the API
#192Earlier quoted context omitted.
Respectfully, After a certain level of compensation, you are indeed judged purely off of input and output. Workplace improvement does not justify your salary. You will also find that many problems in the harder sciences do not get easier by throwing more bodies at them. Comments like these remind me that some project managers think they'd be able to delivery a baby in 1 month if they simply had 9 women.
> you are indeed judged purely off of input and output That's not how successful (software, in this case) teams are made.
I would agree if the team im on were still growing/scaling.
However we are well past our scaling phase, and at this point our concern is maintaining multi-million dollar contracts with a tight well-compensated team.
Re: Claude.ai unavailable and elevated errors on the API
#193Earlier quoted context omitted.
> Would I theoretically have a more stable harness backing my usage? If you don’t mind an opinionated harness that asks for a pretty specific workflow, but one that works well, use OpenCode. If you want to spread your wings and feel the sweet kiss of freedom, use Pi.
Im looking at moving to Pi and I like the minimal nature, but I disagree with a handful of decisions they make. So Id likely need to maintain a fork which is less than ideal.
What decisions is Mario making that you disagree with? My impression is Pi is minimal so any changes can live on top of Pi without needing to maintain a fork?
I started developing my own coding agent after using Pi for a couple months, so I’m curious what you don’t like about pi.
Re: Claude.ai unavailable and elevated errors on the API
#194Earlier quoted context omitted.
GitHub, along with MSFT in general, have massive copilot mandates where workers are being shamed into using slop tools to fix serious on-going issues. GitHub seems wholly incapable of resolving their issues: money isn't a problem, talent isn't a problem, but business leadership is definitely a major problem. Look at how other companies are suffering massive outages due to LLMs too like AWS and Cloudflare. Two compani…
None of the three major Cloudflare outages in the past six months had anything to do with LLMs. They were regular old human mistakes. We did, however, determine that at least one of them (and perhaps all) would have been easily caught by AI code reviewers, had AI code reviewers been in use. So now we mandate that. And honestly, I love it, the AI reviewer spots all sorts of things that humans would probably miss. (We…
> None of the three major Cloudflare outages in the past six months had anything to do with LLMs. They were regular old human mistakes.
Is that true? At least one of them seemed to involve LLM-written code from what I saw. (Not to say that human error wasn't _also_ a contributing factor, but I wouldn't say it had _nothing_ to do with LLMs).
> We did, however, determine that at least one of them (and perhaps all) would have been easily caught by AI code reviewers, had AI code reviewers been in use. So now we mandate that. And honestly, I love it, the AI reviewer spots all sorts of things that humans would probably miss.
The reviewer is decent, but the false positive rate is substantial, and the false negative rate is definitely nonzero. Not that you would know that the way our genius CTO talks about it...
Re: Claude.ai unavailable and elevated errors on the API
#195We're officially down to one 9 of uptime over last 90 days: https://status.claude.com
Not so fast, it's currently 98.59%. That's technically two 9s!
If 90% is one nine and 99% is two nines, we can use the logarithm to compute how many fractional nines we have at 98.59%: about 1.9788 nines (almost two!)
Re: Claude.ai unavailable and elevated errors on the API
#196Earlier quoted context omitted.
The enterprise tier is API pricing only. https://support.claude.com/en/articles/9797531-what-is-the-e...
They'll cut you a private offer for bedrock tokens but bedrock has a 32k output limit
I use bedrock with 1M context every day. Not sure this is right
Re: Claude.ai unavailable and elevated errors on the API
#197We've been running our 10 dev org on 8 H100s on open models (with some tweaks). Sure they aren't as good as the big providers but they 1. don't go down 2. have pretty damn high tok/s. It pays for itself. Posting with a fresh account because I'm not supposed to share these details for obvious reason. If you want help on setting this up, just reply with a way to reach you.
We're planning to do the same thing - buy something like 8xH100 and run all coding there. The CTO almost agreed to find the budget for it but I need to make sure there are no risks before we buy (i.e. it's a viable/usable setup for professional AI-assisted coding)
Can you share what models you run and find best performing for this setup? That would help a lot. I already run a smaller AI server in the office but only 32b models fit there. I already have experience optimizing inference, I'm just interested what models you think are great for 8xH100 for coding, I'll figure out the details how to fit it :)
Re: Claude.ai unavailable and elevated errors on the API
#198Earlier quoted context omitted.
Have you guys considered running your own local models? 200k a month is a ton of money and puts all your eggs in one basket. Or is it easier to just be able to run away from it all if you are done with it or something changes?
I led the team that did the math and analysis for determining our direction in selecting Anthropic. We initially assumed this was where we would end up, but after some investment exploring our options we found it not worth the trouble. Local models sound great until you realize you dont get alot of the features that we implicitly expect from hosted models. Many things would require additional investment into the oper…
> Local models sound great until you realize you dont get alot of the features that we implicitly expect from hosted models. Many things would require additional investment into the operations and setup to get to a comparable system. We ended up wanting things that would require us to roll our own memory system, harnesses for the model, compliance needs, and security.
That's not local models vs hosted models, that's using the enterprise services from Anthropic. Any local LLM inference engine such as VLLM gives you an OpenAI compatible API with the exact same features as a hosted model.
I'm not sure what your use case is, but I personally found Anthropic's offerings lacking and inferior to open source or custom-built solutions. I have yet to see any "memory" system that's better than markdown files or search, and harnesses for agentic AIs are dime a dozen.
Re: Claude.ai unavailable and elevated errors on the API
#199Earlier quoted context omitted.
They weren't able to use it to prevent Claude Code source code from leaking, or from some random Discord server from gaining access to Mythos.
> prevent Claude Code source code from leaking That's silly. It's a JavaScript app, they are more or less open source by design. There was no secret sauce in Claude Code.
Odd hos they still DMCA'd the rehosts of the leak. Clearly they dont consider it "open source".
Re: Claude.ai unavailable and elevated errors on the API
#200Earlier quoted context omitted.
Not so fast, it's currently 98.59%. That's technically two 9s!
If 90% is one nine and 99% is two nines, we can use the logarithm to compute how many fractional nines we have at 98.59%: about 1.9788 nines (almost two!)
I think it was a joke that 98.59% has 2 '9's: 9X.X9%.