Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI unveils its first custom chip, built by Broadcom

techcrunch.com

Post reply on HN
Print view View original

11–20 of 496 posts

Re: OpenAI unveils its first custom chip, built by Broadcom

#11

Post by a_conservative »

shellcromancer wrote: post #4

Probably obvious but still omitted in the OpenAI post: chips are being made by TSMC [1]. Wasn't sure if Intel got it. 1. https://www.investing.com/news/stock-market-news/openai-unve...

I recently put 2+2 together.

Broadcom has become wealthy by being Google's TPU hardware partner, including sharing their TSMC capacity with Google, and evidently now they are doing the same thing with OpenAI. What a brilliant way to take advantage of the AI gold rush!

I wish they weren't using their piles of money to extort money out of the software industry like they are with VMWare and Bitnami.

Re: OpenAI unveils its first custom chip, built by Broadcom

#13

Post by boarush »

qsxfthnkp2322 wrote: post #8

aw shucks nvda has some spicy competition Make sure you all use that fancy ñ

They don't have true competition, what they lose out on is market share with hyperscalers, since OpenAI would have no plans to share inference hardware with any other company right now. Plus, I don't know how does NVIDIA's investment equation pans out long terms given OpenAI will be investing in more purpose built inference stack for the future.

Re: OpenAI unveils its first custom chip, built by Broadcom

#14

Post by thewebguyd »

jerojero wrote: post #6

One thing I don't like about California based companies is how cringe the names always are. "Jalapeño" is such a bad name, having an "ñ" already makes it difficult and annoying to deal with in so many little ways. Good luck with that. But also, theres the sort of "yes lets use Mexican related things because we're California" thought that I just really hate. I don't know, its like corporate Memphis to me. You see a pr…

No worse, I suppose, than, the obsession with Lord of the Rings that the authoritarian surveillance companies have. Palantir, Anduril. Then we have the not defense/surveillance ones: Mithril, Valar, Narya, Erebor

Re: OpenAI unveils its first custom chip, built by Broadcom

#15

Post by forrestthewoods »

maz1b wrote: post #5

Pretty huge move. Google and their TPUs are looking infinitely more prescient as I think they are on their 7th generation, along with the offshoots it inspired like the LPU and even others, perhaps like Cerebras and their Wafer Scale Engine. However, based off first impressions, it seems like this is meant for inference side, and not training, which is also an interesting choice.

Inference costs are higher than training now. I think.

Nvidia is king of general purpose training chips. But inferences can be specialized.

Re: OpenAI unveils its first custom chip, built by Broadcom

#20

Post by HarHarVeryFunny »

shellcromancer wrote: post #4

Probably obvious but still omitted in the OpenAI post: chips are being made by TSMC [1]. Wasn't sure if Intel got it. 1. https://www.investing.com/news/stock-market-news/openai-unve...

I just read a claim on Twitter that the reason these companies (Google and Amazon as well as OpenAI) are using Broadcom isn't just for design expertise, but because Broadcom have allocation agreements in place with TSMC and the memory manufacturers.
Post reply on HN