[flagged]
OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
101–110 of 127 posts
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#102Earlier quoted context omitted.
I'm in the "AI could be good for humanity" camp, and in this camp, we believe that Dario/Anthropic is a radically better choice going forward than the alternatives at this moment. In this camp we are not 'fooled into thinking he's our friend because he said no to Trump that one time', we are evaluating the entire set of available information and figuring that Anthropic's the best bet. As for Musk ever being "the left…
Funny of you to bring up "humanity" while singing praise of the guy who's on record A-OK with aiding mass surveillance of anywhere not the U.S., and who's happy to help kill people but just wouldn't do it fully automatically, merely because he doesn't believe the tech is there yet. All while collaborating with Palantir. If by "the best bet" you mean slightly less shitty bet then maybe.
That’s approximately what I mean. Although in comparison to the alternatives of Altman and Musk, the distinction is stark and significant.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#103Earlier quoted context omitted.
Funny of you to bring up "humanity" while singing praise of the guy who's on record A-OK with aiding mass surveillance of anywhere not the U.S., and who's happy to help kill people but just wouldn't do it fully automatically, merely because he doesn't believe the tech is there yet. All while collaborating with Palantir. If by "the best bet" you mean slightly less shitty bet then maybe.
That’s approximately what I mean. Although in comparison to the alternatives of Altman and Musk, the distinction is stark and significant.
For 96% of humanity it’s same difference.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#104Earlier quoted context omitted.
the way in which Mantle was built is highlighted internally by PEs as some sort of triumph but really its a fairly tone deaf indicted of AWS’s engineering culture ... “To achieve a meaningful result in a reasonable amount of time we had to break nearly ever constraint that we force all other engineers to work under. good luck to you plebs of L6 and below”
I'm going to play devil's advocate here: _what if_ most of lower level engineers are actually not able to self-organize themselves like this dedicated, I bet hand-picked group of PE can? I'm pretty sure AWS ruthless culture would gladly use less middle-managers and be swifter in time to market if it were so easy, no? What works for a single, highly-focused project (or a handful of similar situations) doesn't scale wh…
[deleted]
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#105Earlier quoted context omitted.
at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations
yup, I think there are few public articles on aws mantle so you can look it up, but internally this is pretty common knowledge. The entire inference engine of bedrock is built and maintained by a handful of ec2 engineers (all principals and above). Judging by the commit history of the project they are able to just build independent of any of the traditional bureaucracy.
For better and worse tho.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#106Earlier quoted context omitted.
I'm going to play devil's advocate here: _what if_ most of lower level engineers are actually not able to self-organize themselves like this dedicated, I bet hand-picked group of PE can? I'm pretty sure AWS ruthless culture would gladly use less middle-managers and be swifter in time to market if it were so easy, no? What works for a single, highly-focused project (or a handful of similar situations) doesn't scale wh…
[deleted]
[flagged]
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#107Earlier quoted context omitted.
Which one is better?
For OpenAI, OpenAI direct has always been better; except maybe early 2023-era when OpenAI Platform was not that stable or reliable yet. For Anthropic, it can vary based on model and time. For Opus 4.7, Bedrock is the clear winner in TPS by leaps: https://artificialanalysis.ai/models/claude-opus-4-7/provide...
That artificial analysis page has some great references for this, thanks for sharing.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#108Remember that models on different inference platforms might not necessarily give exactly the same results, adding another axis of non-determinism to development. Things like quantization, custom model serving silicon, batching, or other inference optimizations might mean a model from the original provider performs differently from the hosted one :/ This paper isn't the exact same scenario, since it's an auditable ope…
It's a shame people love to use hostile language (something I am also sometimes to blame), but I think redsocksfan45 misconception is good to address. The comment is however (rightfully) dead. I'll address it anyways.
Model performance consistency is important not because you want inference determinism (which you can actually get by setting tempetature to zero and applying a static seed). The `another axis of non-determinism` can be illustrated by the question "if I move from openrouter to bedrock, will gpt-5.5 perform the same?", to which the answer is no, at least not necessarily.
This is important because workflows that used to work on one platform might degrade or outright not work on another, even using the same model, which you have to account when deciding which provider to use.
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#109Well that didn't take long.
They were working on it since at least halfway March, because that's when MS got annoyed at AWS & OpenAI negotiating - https://www.datacenterdynamics.com/en/news/microsoft-conside...
Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs
#110Earlier quoted context omitted.
the way in which Mantle was built is highlighted internally by PEs as some sort of triumph but really its a fairly tone deaf indicted of AWS’s engineering culture ... “To achieve a meaningful result in a reasonable amount of time we had to break nearly ever constraint that we force all other engineers to work under. good luck to you plebs of L6 and below”
I'm going to play devil's advocate here: _what if_ most of lower level engineers are actually not able to self-organize themselves like this dedicated, I bet hand-picked group of PE can? I'm pretty sure AWS ruthless culture would gladly use less middle-managers and be swifter in time to market if it were so easy, no? What works for a single, highly-focused project (or a handful of similar situations) doesn't scale wh…
Having seen how the sausage is made, Amazon's internal engineering culture is a textbook example of the principal/agent problem. You only get a raise from a promo, and you only get a promo from scope. It's way easier for management to demonstrate scope and so those folks build out empires of crap. In the best case they're just consuming oxygen, but I have definitely seen orgs created that were a negative influence on productivity.