Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI frontier models and Codex are now available on AWS

openai.com

Post reply on HN
Print view View original

11–20 of 158 posts

Re: OpenAI frontier models and Codex are now available on AWS

#11

Post by sokoloff »

easton wrote: post #9
Handy-Man wrote: post #2

More expensive than directly sourcing from OpenAI

The AWS pricing page says 10% more than OpenAI, which is probably because they’re forcing all inference through the US and data residency is at a 10% premium from the model vendors for whatever reason (because you’ll pay for it). If they put in a global endpoint like with Claude (or OpenAI directly) then it’ll probably match the direct pricing, if the pattern holds. ( https://aws.amazon.com/bedrock/pricing/ , scroll…

It also could be to provide room for enterprise discount pricing without it being money-losing for one of the companies.

Re: OpenAI frontier models and Codex are now available on AWS

#12

Post by rho138 »

ykl wrote: post #10

If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons: 1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship 2. Large companies tend to have strong internal requirements about making sure that in…

How is one certain bedrock data isn’t being shuttled to external providers?

Re: OpenAI frontier models and Codex are now available on AWS

#14

Post by cortesoft »

rho138 wrote: post #12
ykl wrote: post #10

If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons: 1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship 2. Large companies tend to have strong internal requirements about making sure that in…

How is one certain bedrock data isn’t being shuttled to external providers?

Contracts and the force of law?

Re: OpenAI frontier models and Codex are now available on AWS

#15

Post by powvans »

Aurornis wrote: post #8

If you are wondering why anyone would spend more money to use these APIs through AWS instead of going direct: In some companies it’s nearly impossible to get new vendors approved. If the company has an AWS contract then you have to use what AWS offers.

Even if you can get it approved you are adding surface area to your annual security audits, adding another vendor that needs to be disclosed on security assessments, spreading your data to yet another processor, and adding another invoice and budget discussion. Depending on your customer contracts you may need to notify them of a new vendor. This might trigger a new security review. Oh it’s just another model on Bedrock? Bliss.

Re: OpenAI frontier models and Codex are now available on AWS

#16

Post by avianlyric »

rho138 wrote: post #12
ykl wrote: post #10

If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons: 1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship 2. Large companies tend to have strong internal requirements about making sure that in…

How is one certain bedrock data isn’t being shuttled to external providers?

Contractual obligation, external third party audits, and above all, AWS’s reputation.

AWS isn’t going to risk their reputation, and thus huge chunks of their business, just so a few AI labs can get some extra training data. That’s an insane risk with zero upside for AWS. AWS knows full well they will make insane quantities of cash without breaking legal contracts with companies who pay them billions each year for infra.

Re: OpenAI frontier models and Codex are now available on AWS

#17

Post by jofzar »

rho138 wrote: post #12
ykl wrote: post #10

If you've used AI coding models in a large corporate setting, you'll know that a lot of big corporate deployments basically require using AWS Bedrock for two simple reasons: 1. Large companies tend to already have an existing relationship with AWS, which makes things way easier to go through vs. setting up a new vendor relationship 2. Large companies tend to have strong internal requirements about making sure that in…

How is one certain bedrock data isn’t being shuttled to external providers?

What other people are saying, but also because Amazon does not want to fuck around in this space. They don't want the legal fight or the reputational damage that would come with it.

Re: OpenAI frontier models and Codex are now available on AWS

#19

Post by [deleted] »

powvans wrote: post #15
Aurornis wrote: post #8

If you are wondering why anyone would spend more money to use these APIs through AWS instead of going direct: In some companies it’s nearly impossible to get new vendors approved. If the company has an AWS contract then you have to use what AWS offers.

Even if you can get it approved you are adding surface area to your annual security audits, adding another vendor that needs to be disclosed on security assessments, spreading your data to yet another processor, and adding another invoice and budget discussion. Depending on your customer contracts you may need to notify them of a new vendor. This might trigger a new security review. Oh it’s just another model on Bedr…

[deleted]

Re: OpenAI frontier models and Codex are now available on AWS

#20

Post by yojo »

sokoloff wrote: post #11
easton wrote: post #9

Earlier quoted context omitted.

The AWS pricing page says 10% more than OpenAI, which is probably because they’re forcing all inference through the US and data residency is at a 10% premium from the model vendors for whatever reason (because you’ll pay for it). If they put in a global endpoint like with Claude (or OpenAI directly) then it’ll probably match the direct pricing, if the pattern holds. ( https://aws.amazon.com/bedrock/pricing/ , scroll…

It also could be to provide room for enterprise discount pricing without it being money-losing for one of the companies.

I have worked at places that have negotiated flat percentage discounts on all AWS spend.

This explanation seems plausible to me.

Post reply on HN