any explanation of why the context window is only 272K?
OpenAI frontier models and Codex are now available on AWS
141–150 of 158 posts
Re: OpenAI frontier models and Codex are now available on AWS
#142If you are wondering why anyone would spend more money to use these APIs through AWS instead of going direct: In some companies it’s nearly impossible to get new vendors approved. If the company has an AWS contract then you have to use what AWS offers.
Every CEO, board, and middle manager in the world is AI buzzword-obsessed now. Surely asking to sign a contract with the frontier labs directly would not get held up?
Re: OpenAI frontier models and Codex are now available on AWS
#143Re: OpenAI frontier models and Codex are now available on AWS
#144Absolutely huge news for OpenAI. Unimaginable amount of enterprises picked up Claude just because it was available in AWS, and now there's serious competition.
Re: OpenAI frontier models and Codex are now available on AWS
#145Re: OpenAI frontier models and Codex are now available on AWS
#146Earlier quoted context omitted.
We have a vendor with almost no subprocessors because they run their own hardware in a colo. It is refreshing actually. They can accurately answer questions on how everything works and there is no subsubsubprocessors to worry about.
I think he's arguing about OpenAI vendoring specifically, where OpenAI has a lot of subprocessors, but AWS doesn't and there's not really a 3rd camp to choose from, yet. But even there you can't just choose AWS as I tried to illustrate in uncle comment.
Re: OpenAI frontier models and Codex are now available on AWS
#147But their contract with Microslop prevents this?!?!? They specifically said like a month ago that they wouldn’t sell API access on AWS, they would only release specific products.
Re: OpenAI frontier models and Codex are now available on AWS
#148Earlier quoted context omitted.
How is one certain bedrock data isn’t being shuttled to external providers?
They could be lying with all this: https://docs.aws.amazon.com/bedrock/latest/userguide/data-pr... But it seems tremendously unlikely with how explicit they are being with it. It is clearly one of the top selling features for the service.
Edit: From your source - “You are responsible for maintaining control over your content that is hosted on this infrastructure.”
So they don’t.
Re: OpenAI frontier models and Codex are now available on AWS
#149Earlier quoted context omitted.
3. from my opportunity - For many (not all) LLMs, Bedrock gives you control over which country the data stays in. You have no control over that with the Claude API, for example. We do not work in the US and have strong requirements for the data to stay in our country, which Bedrock gives us control over.
> We do not work in the US and have strong requirements for the data to stay in our country, which Bedrock gives us control over. It doesn't actually. The US can request data from whatever country US companies store it, and companies must comply. So if you have strong requirements for data to stay in your country, using a US provider, whatever it is, is out of question no matter what the company's marketing claims (t…