211–220 of 277 posts
The spend at my organization has reached beyond the $200,000 per month level on Anthropic's enterprise tier. The amount of outages we have had over these past few months are astounding and coupled with their horrendous support it has our executive team furious. its alot of money to be spending for a single 9 of reliablility.
Earlier quoted context omitted.
In my experience the downtime tends to coincide with peak PT timezones. If you're in PT, it's very inconvienent.
Yeah, I feel like all of the bad downtimes happen during American business hours. We use GitHub at work in Europe and I don't remember it ever being down or broken between 0700 and 1700 local time.
Earlier quoted context omitted.
Truly! As someone who's worked with HPC and GPUs in a scientific research context, trying to get a service like this to work reliably is a different ballgame to your usual webapp stack...
But… imagine that same scientific research but you have an unlimited budget. I’d imagine that helps. Some of the comments here mention their monthly spend, and it’s eye watering.
Earlier quoted context omitted.
Is it worth it?
No, we can literally buy our own hardware for what we spend in a month and host our own local LLMs for company usage.
What local alternative could replace your Anthropic use? I have found none. I don't think many have, which is why most of us pay Anthropic, rather than using one of the numerous, far cheaper, cloud services that host "local" class models.
Most of us are paying for access to proprietary SOTA models, rather than hosting.
Earlier quoted context omitted.
we are in the SMB space, the spend is almost entirely usage for us at this point, rather than seat cost. For context, we are a software firm focused on difficult engineering problems, but I cant divulge much else.
Have you guys considered running your own local models? 200k a month is a ton of money and puts all your eggs in one basket. Or is it easier to just be able to run away from it all if you are done with it or something changes?
Earlier quoted context omitted.
Have you guys considered running your own local models? 200k a month is a ton of money and puts all your eggs in one basket. Or is it easier to just be able to run away from it all if you are done with it or something changes?
Local models perform objectively worse than SotA SaaS models. Your employees will hate this decision.