Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI unveils its first custom chip, built by Broadcom

techcrunch.com

Post reply on HN
Print view View original

271–280 of 496 posts

Re: OpenAI unveils its first custom chip, built by Broadcom

#271

Post by lifeisstillgood »

So I’ve been wondering about “one or two levels back” chip design. If I understand it, 28nm chips (pre EUV) is just about suitable to run (not train just inference) frontier models.

And so if I was a mid-level State would it be worth while to take my nascent chip industry and push it out to build a 28nm foundry and supporting eco-system.

The models will come but the real challenge of the future is having enough compute power for every one and every use. Even if LLMs don’t become AGI they will still be incredible tools - and as OpenAI seems to spend 8000 for each 200 monthly subscription building one’s own data centres seems sensible

Re: OpenAI unveils its first custom chip, built by Broadcom

#273

Post by Schiendelman »

signatoremo wrote: post #262

I haven't seen this discussed here: So far, the accelerator is showing cost savings of roughly 50% compared with typical AI graphics processing units, Broadcom Chief Executive Officer Hock Tan said in an interview. - [0] 50% cost saving. The picture changes so quickly, there are still a lot of low hanging fruits, that I find any discussion about whether a vendor has moats, or if they can recoup investment, is moot an…

"Typical" is doing a lot of work there. That could mean much older chips than Nvidia is currently selling.

Re: OpenAI unveils its first custom chip, built by Broadcom

#275

Post by throwthrowuknow »

nemonemo wrote: post #218
NitpickLawyer wrote: post #144

Earlier quoted context omitted.

> extremely hard sell. It really depends on the pricepoint at which they can get a board. If they can do a ~32B model for 1k$ and a size of an external HDD, I'd buy one now, even knowing that it won't be upgradeable / the model remains fixed. The speeds they've shown are a quality of its own, and there's plenty you can do with such a model and faster than instant responses.

Maybe in 10 years when the tech matures, but IMO now seems a bit too early to have a tech like this. It is like intelligence without evolution or progress.. yes it can be used in some niche markets, but difficult to be generic.

There are plenty of applications that would be useful right now. Specialized models for tool use, like fine tuning for command line tools that are already well established and don’t change often. I’m sure there are many areas where the training data is essential crystallized and unlikely to change. Think of them more like delegated agents or coprocessors that another model could route to so instead of routing to a quantized or lesser model it could use a full fidelity model that is faster, almost instantaneous.

Re: OpenAI unveils its first custom chip, built by Broadcom

#276

Post by mschuster91 »

kccqzy wrote: post #230
a_conservative wrote: post #11

Earlier quoted context omitted.

I recently put 2+2 together. Broadcom has become wealthy by being Google's TPU hardware partner, including sharing their TSMC capacity with Google, and evidently now they are doing the same thing with OpenAI. What a brilliant way to take advantage of the AI gold rush! I wish they weren't using their piles of money to extort money out of the software industry like they are with VMWare and Bitnami.

Well Google has reduced reliance on Broadcom already. They found a new hardware partner, MediaTek, that’s probably much, much cheaper than Broadcom. https://finance.yahoo.com/sectors/technology/articles/broadc...

> Well Google has reduced reliance on Broadcom already. They found a new hardware partner, MediaTek

Oh dear god. I'm actually feeling sorry for Google at that point. Good luck, you'll need it...

Re: OpenAI unveils its first custom chip, built by Broadcom

#277

Post by [deleted] »

cwillu wrote: post #182
knicholes wrote: post #147

Earlier quoted context omitted.

Right. KiCAD for PCB design. Blender for 3D CAD. Oh, are you saying I should have used something other than the KiCAD MCP server for better results?

Meta: can we not downvote people who are clarifying what they're saying and asking questions, even if they're wrong about something, if the content isn't otherwise objectionable?

[deleted]

Re: OpenAI unveils its first custom chip, built by Broadcom

#279

Post by holoduke »

Aurornis wrote: post #95
sharkjacobs wrote: post #61

> Developed from design to production in nine months, accelerated by OpenAI’s models > the use of OpenAI models to accelerate parts of the design and optimization process. I wish there was more about this. As is I kind of have to assume that this is just meaningless marketing, like saying development was accelerated by Microsoft Office or their 5k LG Ultrafine 40-inch monitors. Like, if this was as big a deal as it k…

The hardware description languages (HDL) used in chip development are like programming languages. The existing models understand them and can do a lot with them. You don’t need to have separate, specialty models designed for this work to use LLMs in chip design workflows. Design verification also involves a lot of traditional programming which benefits from LLMs. So it’s not meaningless at all. You could download som…

One day we can design our own pcb with chips, hardware and other io. Companies will accept these as files and you can collect your pcb the same day. I think in China they are doing this already

Re: OpenAI unveils its first custom chip, built by Broadcom

#280

Post by digitaltrees »

some-guy wrote: post #44
digitaltrees wrote: post #40

We’ve entered the “if you care about software, build hardware” phase of AI

I have been eyeing what Taalas is doing [1] by making pure hardware models. The speed is absurd. [1] https://taalas.com/products/

I have and it was wild. Paradoxically it made me realize that I actually like reading the stream as it's generating.
Post reply on HN