Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

stratechery.com

Post reply on HN
Print view View original

71–80 of 127 posts

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#71

Post by felixgallo »

xienze wrote: post #54
felixgallo wrote: post #53

Earlier quoted context omitted.

Thing is, if you're using Codex, you're supporting Sam Altman and the idea of Sam Altmans, in the same way that if you use X or buy a Tesla, you're supporting Elon Musk and the idea of Elon Musks. That's a pretty big tax to factor into the usage of such products. If you even got 5% better coding results, would that make up for the future they're trying to build?

Dario wants to replace you with AI as well. Don't be fooled into thinking he's your friend because he said no to Trump that one time. I'll remind you that Musk used to be the left's hero not too long ago.

I'm in the "AI could be good for humanity" camp, and in this camp, we believe that Dario/Anthropic is a radically better choice going forward than the alternatives at this moment. In this camp we are not 'fooled into thinking he's our friend because he said no to Trump that one time', we are evaluating the entire set of available information and figuring that Anthropic's the best bet.

As for Musk ever being "the left"'s "hero" -- that's amazing, that's what Pauli would call 'not even wrong'.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#72

Post by sheeshkebab »

felixgallo wrote: post #53
jwilliams wrote: post #22

Earlier quoted context omitted.

Codex is pretty good. Its friction to switch but I think it’s sensible being across multiple AI toolchains.

Thing is, if you're using Codex, you're supporting Sam Altman and the idea of Sam Altmans, in the same way that if you use X or buy a Tesla, you're supporting Elon Musk and the idea of Elon Musks. That's a pretty big tax to factor into the usage of such products. If you even got 5% better coding results, would that make up for the future they're trying to build?

The more Dario talks the less I want to have anything to do with his wares.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#73

Post by 7thpower »

zmmmmm wrote: post #62
brokencode wrote: post #59

Earlier quoted context omitted.

Just curious, what’s wrong with Azure?

It might be just our region, but for a long time we couldn't access current frontier models at all. Only old GPT4 level models. Meanwhile, Anthropic is rolling out access to every model within 24 hours of announcement to Bedrock.

Not sure how much Azure OAI has changed, but when I last used it 2-3 years ago, it was just a farce to get you using provisioned throughput. The throughput quotas were small, the process to request more was bureaucratic, and the Azure SAs were

It was also very clear the OAI and MS teams held each other in contempt (not relevant, but was interesting and grew in the immediate aftermath of the Altman drama).

So why were we using it? OpenAI don’t really have an enterprise go to market, bedrock still relied on Claude 2, and we weren’t willing to YOLO on clickthroughs.

Once Claude 3 came out, we jumped ship. That sucked too, although I hear it’s gotten better though.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#74

Post by Silfen »

KaiserPro wrote: post #40

Great, I can now buy openAI through AWS with an interface that is totally incompatible with all my tools (unless AWS have finally given up and just made bedrock useful by adopting openAPI finally)

https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock...

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#75

Post by spelunker »

33MHz-i486 wrote: post #68
aab99 wrote: post #57

Earlier quoted context omitted.

yup, I think there are few public articles on aws mantle so you can look it up, but internally this is pretty common knowledge. The entire inference engine of bedrock is built and maintained by a handful of ec2 engineers (all principals and above). Judging by the commit history of the project they are able to just build independent of any of the traditional bureaucracy.

the way in which Mantle was built is highlighted internally by PEs as some sort of triumph but really its a fairly tone deaf indicted of AWS’s engineering culture ... “To achieve a meaningful result in a reasonable amount of time we had to break nearly ever constraint that we force all other engineers to work under. good luck to you plebs of L6 and below”

Check out this all of this stuff we can build with a room full of PEs and no rules!

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#76

Post by tt24 »

o10449366 wrote: post #28
33MHz-i486 wrote: post #8

Earlier quoted context omitted.

at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations

Lol, spinning up swat teams because someone high up decides "drop everything this is my pet priority now" is politicking. It looks good for the leaders, meanwhile its the engineers pulling the all nighters and dealing with having to maintain systems that are operationally compromised from day 0 because there's no proper planning/scoping involved other than "Big Man says this needs to be done in 2 weeks"

Okay but I’ll be able to use OpenAI models on bedrock now

Why would I care if AWS asks their engineers to work a little harder on a project

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#77

Post by TZubiri »

epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

It's like Coca-Cola being banned at a school, and then Pepsi getting some contracts with the cafeteria because of it.

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#78

Post by ignoramous »

o10449366 wrote: post #28
33MHz-i486 wrote: post #8

Earlier quoted context omitted.

at this level they just decide and spin up a swat team to execute it in a couple weeks without politicking. the bureaucratic ways, reviews are just for the low levels, to keep them busy with feature scraps while they mostly do operations

Lol, spinning up swat teams because someone high up decides "drop everything this is my pet priority now" is politicking. It looks good for the leaders, meanwhile its the engineers pulling the all nighters and dealing with having to maintain systems that are operationally compromised from day 0 because there's no proper planning/scoping involved other than "Big Man says this needs to be done in 2 weeks"

> engineers pulling the all nighters

There's always some carrot with the stick, even if an imaginary one!

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#79

Post by ignoramous »

NamlchakKhandro wrote: post #34
londons_explore wrote: post #19

Earlier quoted context omitted.

I imagine there's lots of custom kernels and optimization... Openai hasn't been publishing innovations for quite a while.

Neither has anthropic. They're both just stealing ideas from pimono extensions

Some say they have been stealing ideas from Chaebols [0] on circular deals [1], government reciprocation, & monopolisation.

[0] https://business.columbia.edu/sites/default/files-efs/imce-u...

[1] https://www.reuters.com/business/autos-transportation/compan...

Re: OpenAI models coming to Amazon Bedrock: Interview with OpenAI and AWS CEOs

#80

Post by stingraycharles »

bg24 wrote: post #58
epistasis wrote: post #10

Claude got a looooot more buy in with a lot of privacy-concerned orgs I work with because they could access it through their "trusted" intermediate Amazon. OpenAI has been banned and is not trusted. I'm not sure that I agree with these orgs' legal teams' assessments, but they definitely read the terms of service far closer than I did. We will see if this changes the equation, but it feels like OpenAI is pretty far be…

While Anthopic has the best model and a focussed (no disturbance, lawsuits) leadership, they got a lot of enterprise access due to AWS. It is mutual no doubt, with both sides benefitting. The culture of feedback loop of AWS customers would have helped them in getting to enterprise-ready faster. Just my hypothesis.

But Azure is just as big, if not equally big, in Enterprise. The argument that Azure didn’t give them enough access within enterprises doesn’t make sense to me.
Post reply on HN