Live data from Hacker News

OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

stratechery.com

61–70 of 127 posts

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#61
post #14

Earlier quoted context omitted.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

Codex is pretty good. Its friction to switch but I think it’s sensible being across multiple AI toolchains.

No friction in switching coding models.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#62
post #41

Availability through Bedrock has been a major driver in use of Anthropic in my org. And I am betting there is actual margin in it as well. I wonder if this is directly linked to the split up with Microsoft. Just from my anecdata, OpenAI is getting completely ignored in serious enterprise deployments because what they offer on Azure sucks and there is no other corporate friendly way to get it. They probably saw themse…

Just curious, what’s wrong with Azure?

It might be just our region, but for a long time we couldn't access current frontier models at all. Only old GPT4 level models. Meanwhile, Anthropic is rolling out access to every model within 24 hours of announcement to Bedrock.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#63
post #55

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

You can sign ZDR agreements with any of the major LLM providers. Using AWS alone is also not sufficient. Even though AWS is running the model, you need to contact them for proper ZDR.[0] [0]: https://platform.claude.com/docs/en/build-with-claude/claude...

Helpful link. Thank you.

I think that when people are worried about ZDR, what they really worry about is data governance. From what I’ve seen there’s a general distrust of OpenAI. AWS may keep your data around (without formal ZDR) but the concern of governance (using your data to train without your consent) seems like it would be much lower, because any breach of contract at AWS would have potential to destroy trust in what’s already a massively profitable company, so the incentives just aren’t there.

I’m not claiming OpenAI is training on API data. Just that they don’t have as strong of an incentive not to as AWS.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#64

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

Legally, SLA, and data concern-wise, is this any better than OpenAI on Azure? That has been around for a while.

By default you can’t access the latest OpenAI models unless you request access. We requested access for a very straightforward use case and never got it. We switched to Anthropic and Bedrock for that reason.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#65

Great, I can now buy openAI through AWS with an interface that is totally incompatible with all my tools (unless AWS have finally given up and just made bedrock useful by adopting openAPI finally)

Product Manager for Bedrock Mantle here. We now have bedrock-mantle endpoint which supports OpenAI API compatibility with Responses and Chat Completions support. See https://docs.aws.amazon.com/bedrock/latest/userguide/endpoin...

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#67

Now they are ruining amazon too. It's fascinating to see. AI is kind of like the ultimate corporation drug. They are all on it. And can't get rid of it - ever again.

How are they "ruining" Amazon with these launches? That is not clear to me.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#68
post #57

Earlier quoted context omitted.

at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations

yup, I think there are few public articles on aws mantle so you can look it up, but internally this is pretty common knowledge. The entire inference engine of bedrock is built and maintained by a handful of ec2 engineers (all principals and above). Judging by the commit history of the project they are able to just build independent of any of the traditional bureaucracy.

the way in which Mantle was built is highlighted internally by PEs as some sort of triumph but really its a fairly tone deaf indicted of AWS’s engineering culture ... “To achieve a meaningful result in a reasonable amount of time we had to break nearly ever constraint that we force all other engineers to work under. good luck to you plebs of L6 and below”

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#69

Earlier quoted context omitted.

Legally, SLA, and data concern-wise, is this any better than OpenAI on Azure? That has been around for a while.

By default you can’t access the latest OpenAI models unless you request access. We requested access for a very straightforward use case and never got it. We switched to Anthropic and Bedrock for that reason.

[deleted]

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#70
post #55

Earlier quoted context omitted.

You can sign ZDR agreements with any of the major LLM providers. Using AWS alone is also not sufficient. Even though AWS is running the model, you need to contact them for proper ZDR.[0] [0]: https://platform.claude.com/docs/en/build-with-claude/claude...

Helpful link. Thank you. I think that when people are worried about ZDR, what they really worry about is data governance. From what I’ve seen there’s a general distrust of OpenAI. AWS may keep your data around (without formal ZDR) but the concern of governance (using your data to train without your consent) seems like it would be much lower, because any breach of contract at AWS would have potential to destroy trust…

AWS took limited data retention very seriously starting around 2015. Before that it was reasonable controls and a strong culture preserving customer privacy. After 2015ish they started implementing strong controls, to where service team members cant feasibly access customer data in the service they run, and account termination starts a legit data removal process (“GDPR compliance”). They also take the terms of service and user agreement (“your data” etc) very seriously in general.
Post reply on HN