OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
1–10 of 127 posts
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#2OpenAI frontier models coming to Bedrock soon?
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#3OpenAI frontier models coming to Bedrock soon?
> Starting today, @awscloud and OpenAI are bringing the latest OpenAI models to Amazon Bedrock, launching Codex on Amazon Bedrock, and launching Amazon Bedrock Managed Agents, powered by OpenAI (all in limited preview). AWS and OpenAI will continue to bring the latest advances to Amazon Bedrock—so the models and agents you build with today continue to benefit from new breakthroughs as they arrive.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#4OpenAI frontier models coming to Bedrock soon?
We've updated the title above to make that clearer.
Since the product doesn't seem to be available yet, and the other links are all press releases, we'll leave the interview up as the main link.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#5As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#6Well that didn't take long.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#7Remember that models on different inference platforms might not necessarily give exactly the same results, adding another axis of non-determinism to development. Things like quantization, custom model serving silicon, batching, or other inference optimizations might mean a model from the original provider performs differently from the hosted one :/
This paper isn't the exact same scenario, since it's an auditable open weight llama model, but shows the symptoms of this: https://arxiv.org/pdf/2410.20247
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#8As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.
at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#9As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.
Depends on how its implemented, but Amazon already did add gpt-oss-20b so if the model is similar enough to the OSS variant of GPT, it might not have been as complicated as you might think.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#10Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did.
We will see if this changes the equation, but it feels like OpenAI is pretty far behind and playing catch up on all fronts. Though to be honest, "pretty far behind" is like 2-8 weeks in the AI world, so it may not matter a ton, it's mostly perception. And for me and my information bubble, perception of OpenAI is rock-bottom due to Sam Altman. From appearing unethical to appearing unhinged with demands from fabs and everything else, I'm not a fan.