Live data from Hacker News

OpenAI unveils its first custom chip, built by Broadcom

techcrunch.com

81–90 of 496 posts

Re: OpenAI unveils its first custom chip, built by Broadcom

#81
post #68

> Developed from design to production in nine months, accelerated by OpenAI’s models > the use of OpenAI models to accelerate parts of the design and optimization process. I wish there was more about this. As is I kind of have to assume that this is just meaningless marketing, like saying development was accelerated by Microsoft Office or their 5k LG Ultrafine 40-inch monitors. Like, if this was as big a deal as it k…

Right. There are two possible meanings and shades in-between: 1) OpenAI genuinely have AI technologies that can improve chip design (bold, unlikely claim, needs evidence) 2) OpenAI designed test/verification models and kernels that could be run on the simulated hardware to test its performance As you and others have said, it's hard to trust when they are happy to write something that could easily only mean the latter…

3) The engineers working on the chip used ChatGPT from time to time.

Re: OpenAI unveils its first custom chip, built by Broadcom

#82
post #59

Look at the SIZE of that chip. Cerebras stock is down nearly 20% today. Not only is approach overlapping, OpenAI is also Cerebras's only major customer.

I think Cerebras stock going down could also be partly caused by the lock-up period ending today for 200k shares (page 73 of their prospectus) - https://www.sec.gov/Archives/edgar/data/2021728/000162828026...

It doesn’t seem like it? Unless I am misunderstanding these Nasdaq insider trading reports: https://www.nasdaq.com/market-activity/stocks/cbrs/insider-a...

Re: OpenAI unveils its first custom chip, built by Broadcom

#83
post #68

> Developed from design to production in nine months, accelerated by OpenAI’s models > the use of OpenAI models to accelerate parts of the design and optimization process. I wish there was more about this. As is I kind of have to assume that this is just meaningless marketing, like saying development was accelerated by Microsoft Office or their 5k LG Ultrafine 40-inch monitors. Like, if this was as big a deal as it k…

Right. There are two possible meanings and shades in-between: 1) OpenAI genuinely have AI technologies that can improve chip design (bold, unlikely claim, needs evidence) 2) OpenAI designed test/verification models and kernels that could be run on the simulated hardware to test its performance As you and others have said, it's hard to trust when they are happy to write something that could easily only mean the latter…

Or OpenAI accelerated the design and optimization process by summarizing emails exchanged during the design and optimization process, or made it possible to ask an AI questions about meeting notes

Re: OpenAI unveils its first custom chip, built by Broadcom

#84
post #59

Look at the SIZE of that chip. Cerebras stock is down nearly 20% today. Not only is approach overlapping, OpenAI is also Cerebras's only major customer.

If you're referring to the big circle of silicon, that's a wafer, generally contains many chips (100-1000s).

Everybody here knows that.

What some don't know (including you) is that the industry is doing wafer-sized chips nowadays, of which Cerebras is the flagship company.

That's why the stock movement could be related, and that is why GP wrote that comment.

Re: OpenAI unveils its first custom chip, built by Broadcom

#85

Earlier quoted context omitted.

Who's IPO? Broadcom and Google are already listed, obviously.

OpenAI, the non profit organization, is going to become a publically traded profit maximizing corporation

> OpenAI, the non profit organization

No, the nonprofit org stays nonprofit, while the for-profit org it owns will become publically traded.

See https://openai.com/index/evolving-our-structure/

Re: OpenAI unveils its first custom chip, built by Broadcom

#86
This is very cool to see - seems like soooo much efficiency waiting to be unlocked at the chip level.

What's everyone think of Taalas?

They're actually burning the LLM model into the silicon, with some onboard memory for fine-tuning. They claim huge cost / latency wins.

Super fast demo live at: https://chatjimmy.ai/

https://taalas.com/

https://www.reddit.com/r/singularity/comments/1r9frzk/taalas...

Re: OpenAI unveils its first custom chip, built by Broadcom

#87

> Developed from design to production in nine months, accelerated by OpenAI’s models > the use of OpenAI models to accelerate parts of the design and optimization process. I wish there was more about this. As is I kind of have to assume that this is just meaningless marketing, like saying development was accelerated by Microsoft Office or their 5k LG Ultrafine 40-inch monitors. Like, if this was as big a deal as it k…

NVIDIA already designs most of their chips using AI. Why would you assume it's meaningless marketing?

[dead]

Re: OpenAI unveils its first custom chip, built by Broadcom

#90
post #81
post #68

Earlier quoted context omitted.

Right. There are two possible meanings and shades in-between: 1) OpenAI genuinely have AI technologies that can improve chip design (bold, unlikely claim, needs evidence) 2) OpenAI designed test/verification models and kernels that could be run on the simulated hardware to test its performance As you and others have said, it's hard to trust when they are happy to write something that could easily only mean the latter…

3) The engineers working on the chip used ChatGPT from time to time.

I'd be shocked if it was anything more than this.
Post reply on HN