81–90 of 127 posts
Availability through Bedrock has been a major driver in use of Anthropic in my org. And I am betting there is actual margin in it as well. I wonder if this is directly linked to the split up with Microsoft. Just from my anecdata, OpenAI is getting completely ignored in serious enterprise deployments because what they offer on Azure sucks and there is no other corporate friendly way to get it. They probably saw themse…
Availability through Bedrock has been a major driver in use of Anthropic in my org. And I am betting there is actual margin in it as well. I wonder if this is directly linked to the split up with Microsoft. Just from my anecdata, OpenAI is getting completely ignored in serious enterprise deployments because what they offer on Azure sucks and there is no other corporate friendly way to get it. They probably saw themse…
Just curious, what’s wrong with Azure?
Earlier quoted context omitted.
It might be just our region, but for a long time we couldn't access current frontier models at all. Only old GPT4 level models. Meanwhile, Anthropic is rolling out access to every model within 24 hours of announcement to Bedrock.
Not sure how much Azure OAI has changed, but when I last used it 2-3 years ago, it was just a farce to get you using provisioned throughput. The throughput quotas were small, the process to request more was bureaucratic, and the Azure SAs were It was also very clear the OAI and MS teams held each other in contempt (not relevant, but was interesting and grew in the immediate aftermath of the Altman drama). So why were…
So yeah Azure sucked ass and plenty of outages or latency, like 3min for first byte while usually it was max 30sec to 1min, if not even faster (memory is a bit fussy)
Microsoft Azure has been the worst interms of maintaining a highly available service and also managing predictable latency.
Their azure customer support is bad. Not ready for any real enterprise cloud offering. They behave like Comcast customer support.
It was absolutely idiotic to lock it down to Azure. It wasn't meant to be an iphone+at&t combo where the phone is an end all be all.
A cloud product depends on a lot of services and nobody would switch cloud providers for a candy.
Remember that models on different inference platforms might not necessarily give exactly the same results, adding another axis of non-determinism to development. Things like quantization, custom model serving silicon, batching, or other inference optimizations might mean a model from the original provider performs differently from the hosted one :/ This paper isn't the exact same scenario, since it's an auditable ope…
Anyone who has used gpt-x via openai vs microsoft has experienced this very clearly.
Great, I can now buy openAI through AWS with an interface that is totally incompatible with all my tools (unless AWS have finally given up and just made bedrock useful by adopting openAPI finally)
Product Manager for Bedrock Mantle here. We now have bedrock-mantle endpoint which supports OpenAI API compatibility with Responses and Chat Completions support. See https://docs.aws.amazon.com/bedrock/latest/userguide/endpoin...
Earlier quoted context omitted.
Anyone who has used gpt-x via openai vs microsoft has experienced this very clearly.
Which one is better?
Earlier quoted context omitted.
Anyone who has used gpt-x via openai vs microsoft has experienced this very clearly.
Which one is better?
For Anthropic, it can vary based on model and time. For Opus 4.7, Bedrock is the clear winner in TPS by leaps: https://artificialanalysis.ai/models/claude-opus-4-7/provide...
Earlier quoted context omitted.
While Anthopic has the best model and a focussed (no disturbance, lawsuits) leadership, they got a lot of enterprise access due to AWS. It is mutual no doubt, with both sides benefitting. The culture of feedback loop of AWS customers would have helped them in getting to enterprise-ready faster. Just my hypothesis.
But Azure is just as big, if not equally big, in Enterprise. The argument that Azure didn’t give them enough access within enterprises doesn’t make sense to me.