Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

stratechery.com

Post reply on HN
Print view View original

21–30 of 127 posts

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#21

Post by londons_explore »

echelon wrote: post #12

This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque? You can just run "air gapped" inference? Is this only of interest to enterprise customers already on AWS (who want "air gapped" behavior)? Is there any other use case for this? This will be more expensive than calling OpenAI directly, right?

This is for people who don't trust openAI with their data, but do trust Amazon.

But it also is for Devs in a company who already have a blanket agreement with Amazon, but would have an uphill battle signing an agreement with openAI.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#22

Post by jwilliams »

echelon wrote: post #14
outside1234 wrote: post #13

Earlier quoted context omitted.

The thing they are really wildly behind on is a business model. They are losing wild amounts of money per customer and it is hard to see how the competitive situation is going to allow them to fix that.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

Codex is pretty good. Its friction to switch but I think it’s sensible being across multiple AI toolchains.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#23

Post by jfkimmes »

epistasis wrote: post #16
echelon wrote: post #14

Earlier quoted context omitted.

Given the scaling hurdles Claude Code / Opus is having, those Anthropic customers might leave to Codex. I'm _this_ close.

I'm getting pretty close too, but I wouldn't switch to Codex I'd switch to one of the open agents that can use any backing LLM. My reasoning is that if I'm willing to pay the cost of the small changes in usage, I might as well switch to an open source agent that I can add my own convenience features to, like remote sessions and phone-based operation.

Codex is open source and allows any model to be configured.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#24

Post by epistasis »

jfkimmes wrote: post #23
epistasis wrote: post #16

Earlier quoted context omitted.

I'm getting pretty close too, but I wouldn't switch to Codex I'd switch to one of the open agents that can use any backing LLM. My reasoning is that if I'm willing to pay the cost of the small changes in usage, I might as well switch to an open source agent that I can add my own convenience features to, like remote sessions and phone-based operation.

Codex is open source and allows any model to be configured.

Many thanks for that info!

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#27

Post by bossyTeacher »

jfkimmes wrote: post #23
epistasis wrote: post #16

Earlier quoted context omitted.

I'm getting pretty close too, but I wouldn't switch to Codex I'd switch to one of the open agents that can use any backing LLM. My reasoning is that if I'm willing to pay the cost of the small changes in usage, I might as well switch to an open source agent that I can add my own convenience features to, like remote sessions and phone-based operation.

Codex is open source and allows any model to be configured.

Why Codex when you can use something that hasn't been touched by Sam Altman? Surely, your drive to get the very best model isn't stronger than your sense of ethics?

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#28

Post by o10449366 »

33MHz-i486 wrote: post #8
jasobake wrote: post #5

As someone who works at big tech and spends countless hours in meetings hoping to get some small feature coordinated for deployment across two teams, I can't imagine the amount of meetings and 6-pagers that were involved in running these models on bedrock's hardware.

at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations

Lol, spinning up swat teams because someone high up decides "drop everything this is my pet priority now" is politicking. It looks good for the leaders, meanwhile its the engineers pulling the all nighters and dealing with having to maintain systems that are operationally compromised from day 0 because there's no proper planning/scoping involved other than "Big Man says this needs to be done in 2 weeks"

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#29

Post by bossyTeacher »

spindump8930 wrote: post #7

Remember that models on different inference platforms might not necessarily give exactly the same results, adding another axis of non-determinism to development. Things like quantization, custom model serving silicon, batching, or other inference optimizations might mean a model from the original provider performs differently from the hosted one :/ This paper isn't the exact same scenario, since it's an auditable ope…

Anyone who has used gpt-x via openai vs microsoft has experienced this very clearly.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#30

Post by kube-system »

echelon wrote: post #12

This doesn't mean you have the raw model weights, right? That's still entirely hidden / opaque? You can just run "air gapped" inference? Is this only of interest to enterprise customers already on AWS (who want "air gapped" behavior)? Is there any other use case for this? This will be more expensive than calling OpenAI directly, right?

A lot of companies already have data processing agreements and compliance sign-off for using AWS. Many are hesitant to send their data to AI startups with an incentive to train their models and a history of being.... loose with how they intake training data. Even when they do give assurances otherwise. AWS is more trusted in this aspect.

If this ends up similar to Claude on Bedrock, it's the same price.

Post reply on HN