Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

stratechery.com

Post reply on HN
Print view View original

11–20 of 127 posts

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#11

Post by giancarlostoro »

epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

They're also not focused exclusively only on building an LLM, they have video and image generation too. Anthropic has one single focus, and this is why they are usually at the very top in the SWE benchmarks.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#12

Post by echelon »

This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque?

You can just run "air gapped" inference?

Is this only of interest to enterprise customers already on AWS (who want "air gapped" behavior)? Is there any other use case for this?

This will be more expensive than calling OpenAI directly, right?

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#13

Post by outside1234 »

epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

The thing they are really wildly behind on is a business model. They are losing wild amounts of money per customer and it is hard to see how the competitive situation is going to allow them to fix that.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#14

Post by echelon »

outside1234 wrote: post #13
epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

The thing they are really wildly behind on is a business model. They are losing wild amounts of money per customer and it is hard to see how the competitive situation is going to allow them to fix that.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#16

Post by epistasis »

echelon wrote: post #14
outside1234 wrote: post #13

Earlier quoted context omitted.

The thing they are really wildly behind on is a business model. They are losing wild amounts of money per customer and it is hard to see how the competitive situation is going to allow them to fix that.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

I'm getting pretty close too, but I wouldn't switch to Codex I'd switch to one of the open agents that can use any backing LLM. My reasoning is that if I'm willing to pay the cost of the small changes in usage, I might as well switch to an open source agent that I can add my own convenience features to, like remote sessions and phone-based operation.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#17

Post by ribosometronome »

echelon wrote: post #14
outside1234 wrote: post #13

Earlier quoted context omitted.

The thing they are really wildly behind on is a business model. They are losing wild amounts of money per customer and it is hard to see how the competitive situation is going to allow them to fix that.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

What would be subscription customers, no? Rather than Bedrock or per-api customers? Many of the companies running on Bedrock or by-use have per day limits above the max monthly subscription costs.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#18

Post by epistasis »

giancarlostoro wrote: post #11
epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

They're also not focused exclusively only on building an LLM, they have video and image generation too. Anthropic has one single focus, and this is why they are usually at the very top in the SWE benchmarks.

IMHO the benchmarks aren't useful, and ranking among the frontier models is mostly noise. The extra features around the coding agent have a much bigger impact on productivity than having to provide slightly more specification and guidance to the models; a 90% success rate versus a 92% success rate on the tasks I ask it to do is far more influenced by what I say than what the model is capable of.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#19

Post by londons_explore »

giancarlostoro wrote: post #9
jasobake wrote: post #5

As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.

Depends on how its implemented, but Amazon already did add gpt-oss-20b so if the model is similar enough to the OSS variant of GPT, it might not have been as complicated as you might think.

I imagine there's lots of custom kernels and optimization...

Openai hasn't been publishing innovations for quite a while.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#20

Post by phillipcarter »

giancarlostoro wrote: post #11
epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

They're also not focused exclusively only on building an LLM, they have video and image generation too. Anthropic has one single focus, and this is why they are usually at the very top in the SWE benchmarks.

Isn't it the case that OpenAI and Anthropic regularly just swap for whoever is at the top of the latest benchmarks? They're also so close in scores that it's effectively a wash anyways.

What OP is referring to is Anthropic aligning with corporate terms and conditions early, positioning themselves to be effectively resold by AWS rather than requiring orgs to procure them directly. This is huge in the enterprise world because the processes to get broad approval are generally far smaller and shorter for "just another AWS service" compared to a whole new vendor.

Post reply on HN