Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI unveils its first custom chip, built by Broadcom

techcrunch.com

Post reply on HN
Print view View original

151–160 of 496 posts

Re: OpenAI unveils its first custom chip, built by Broadcom

#151

Post by pennomi »

admax88qqq wrote: post #131
deweywsu wrote: post #122

With the pace of AI, and with AI helping to pave the way for faster/better AI, I keep wondering if hardware like this will become obsolete well before it has a meaningful ROI. Huge AI models can be run with less resources already through quantization and offloading, but that's just the beginning. One day, maybe not far from now, a breakthrough will allow huge LLMs (say 200B in size) to run well on an old 5 year old D…

> One day, maybe not far from now, a breakthrough will allow huge LLMs (say 200B in size) to run well on an old 5 year old Dell desktop. But if you have such a breakthrough could you not also apply it and run 200T models on todays datacenters?

That assumes scaling laws still hold up. A bigger model might end up only incrementally more intelligent.

Re: OpenAI unveils its first custom chip, built by Broadcom

#152

Post by andriy_koval »

deweywsu wrote: post #122

With the pace of AI, and with AI helping to pave the way for faster/better AI, I keep wondering if hardware like this will become obsolete well before it has a meaningful ROI. Huge AI models can be run with less resources already through quantization and offloading, but that's just the beginning. One day, maybe not far from now, a breakthrough will allow huge LLMs (say 200B in size) to run well on an old 5 year old D…

> I keep wondering if hardware like this will become obsolete well before it has a meaningful ROI

it will build expertise/infra/know-how foundation for next generation of hardware

Re: OpenAI unveils its first custom chip, built by Broadcom

#153

Post by dofm »

fl4regun wrote: post #113
lovasoa wrote: post #81

Earlier quoted context omitted.

3) The engineers working on the chip used ChatGPT from time to time.

at the hardware company I work at, people are now using claude code and developing skills for it to do basic stuff like triage or do initial debug on failing tests, search for potential causes in RTL, generate skeleton documentation for designs etc

But isn't this rather the ordinary product of an LLM, now?

Is it worth the claim that they are making in a press release?

Re: OpenAI unveils its first custom chip, built by Broadcom

#155

Post by Chu4eeno »

nok22kon wrote: post #141
Imustaskforhelp wrote: post #112

Earlier quoted context omitted.

Could you give me some example how in robotics it can be an absolute revolution? My understanding is that robotics doesn't really rely much on LLM's in the first place but rather other things. Is the thing that you are suggesting that it would ingest all real time data and then reason through it at an incredibly fast speed and then act on it and re-iterate? I might imagine some problems with this though I am not a ro…

LLM are very good at looking at images and reasoning about them. much more than just object recognition/segmentation, they can explain the physics in the image, the intents, plan actions, ...

That's because of posttraining optimizing for benchmarks that test that.

They tend to collapse into nonsense and hallucinations pretty quickly if you move slightly out of the envelope of the current visual reasoning benchmaxxing.

Re: OpenAI unveils its first custom chip, built by Broadcom

#156

Post by dcrazy »

knicholes wrote: post #147
Aurornis wrote: post #136

Earlier quoted context omitted.

> I tried making a button using Claude entirely (including the 3D printed enclosure) and it effed up pretty hard with the traces and the header spacing. PCB design and 3D CAD design are different topics. Hardware Description Languages are closer to programming languages than CAD. Look at some Verilog to get an idea - https://en.wikipedia.org/wiki/Verilog

Right. KiCAD for PCB design. Blender for 3D CAD. Oh, are you saying I should have used something other than the KiCAD MCP server for better results?

They’re saying that VHDL is an entirely different concept than physical modeling.

Re: OpenAI unveils its first custom chip, built by Broadcom

#157

Post by LZ_Khan »

deweywsu wrote: post #122

With the pace of AI, and with AI helping to pave the way for faster/better AI, I keep wondering if hardware like this will become obsolete well before it has a meaningful ROI. Huge AI models can be run with less resources already through quantization and offloading, but that's just the beginning. One day, maybe not far from now, a breakthrough will allow huge LLMs (say 200B in size) to run well on an old 5 year old D…

I think Jevons Paradox and scaling laws will make this not the case. If bigger models are always better (which seems they are), then will always need high-end hardware.

Re: OpenAI unveils its first custom chip, built by Broadcom

#158

Post by nullsanity »

oceanplexian wrote: post #126
dofm wrote: post #68

Earlier quoted context omitted.

Right. There are two possible meanings and shades in-between: 1) OpenAI genuinely have AI technologies that can improve chip design (bold, unlikely claim, needs evidence) 2) OpenAI designed test/verification models and kernels that could be run on the simulated hardware to test its performance As you and others have said, it's hard to trust when they are happy to write something that could easily only mean the latter…

> OpenAI genuinely have AI technologies that can improve chip design (bold, unlikely claim, needs evidence) Why is that a bold and unlikely claim? Are you saying that AI, which has been proven to cure diseases, solve our hardest math problems, write complex computer code and generate entire generated worlds and HD video from a simple prompt would somehow be like, my bad, I guess I can't design chips?

[dead]

Re: OpenAI unveils its first custom chip, built by Broadcom

#160

Post by xnx »

changoplatanero wrote: post #97
Catloafdev wrote: post #90

Earlier quoted context omitted.

I'd be shocked if it was anything more than this.

Browsing openai's job postings in the past few months is enough to contirm that it's more than this. They are for sure making serious efforts at building ai for chip design.

Impossible to know. Could be fake/aspirational roles to impress investors with their grand vision.
Post reply on HN