Live data from Hacker News

Cerebras’ new monster AI chip adds 1.4T transistors

spectrum.ieee.org

21–30 of 169 posts

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#21
post #15

How do they do heat management and dissipation on such a big wafer? I can imagine some different parts heats up differently, putting a mechanical strain on wafer, and leading to cracks.

"Carefully."

The article mentions a year of engineering went into dealing with the entire wafer thermally expanding under load.

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#22

Most interesting aspect of wafer-scale manufacturing is yield. Even if we have 95% chip yield, as the chip size approaches the wafer-level dimensions, I don't know off top of my head what the math would be but it is going to plummet drastically. My guess is that they're handling this in the chip logic. Building resiliency by turning off cells in the wafer that didn't yield. That begs the question, how are they probin…

The first Cerebras Wafer Scale Engine used "... breakthrough techniques in cross-reticle patterning, but with the level of redundancy built into the design, ensured a yield of 100%, every time." I'm unsure what to think of this.

"When we spoke to Cerebras last year, the company stated that they already had orders in the ‘strong double digits’."

And they cost 2- 2.5 million each!

https://www.anandtech.com/show/15838/cerebras-wafer-scale-en...

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#24

Time for an AI winter I guess.

You do realize that AI crossed human expert performance in NLP / Vision tasks ?

I'm not sure if you're assuming best intentions. If you do, it'd be nice to provide sources - to my knowledge, vision under non-optimal conditions (rain, snow, sunlight ahead) is only partially solved by resorting to sensors resistant to the disturbance.

I'd be glad to learn I'm wrong.

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#25

How much memory is on the chip, and what kind is it? Under what circumstances does the chip need to access external memory? What type of communication interfaces does this chip have? Also, if the chip is the size of a wafer, is it appropriate to call it a Chip?

Tom's Hardware has some nice tables comparing the specs: https://www.tomshardware.com/news/cerebras-wafer-scale-engin...

(more than the IEEE)

This thing pulls 15-20kW of juice!

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#26

How much memory is on the chip, and what kind is it? Under what circumstances does the chip need to access external memory? What type of communication interfaces does this chip have? Also, if the chip is the size of a wafer, is it appropriate to call it a Chip?

40GB of SRAM. Not quite big enough to fit the big models like GPT3

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#27

How much memory is on the chip, and what kind is it? Under what circumstances does the chip need to access external memory? What type of communication interfaces does this chip have? Also, if the chip is the size of a wafer, is it appropriate to call it a Chip?

It's 40 GB of SRAM. I doubt it supports external memory.

> Also, if the chip is the size of a wafer, is it appropriate to call it a Chip?

Good question. I think it is. I mean the word "chip" isn't really that well defined (is HBM one chip?), but given that they sell it as a single unit and you can't really cut it in half I think it's one chip.

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#28
post #15

How do they do heat management and dissipation on such a big wafer? I can imagine some different parts heats up differently, putting a mechanical strain on wafer, and leading to cracks.

A large portion of the article is answering most of this

No, it does not. There is a paragraph _talking_ about it, but not much info still.

Re: Cerebras’ new monster AI chip adds 1.4T transistors

#30

How much memory is on the chip, and what kind is it? Under what circumstances does the chip need to access external memory? What type of communication interfaces does this chip have? Also, if the chip is the size of a wafer, is it appropriate to call it a Chip?

Tom's Hardware has some nice tables comparing the specs: https://www.tomshardware.com/news/cerebras-wafer-scale-engin... (more than the IEEE) This thing pulls 15-20kW of juice!

I did a double that when I realised that was Kilowatts not Watts. This chip uses more energy in an hour than the average household (in my country at least) does in a day.

It may be a very large wafer but dissipating that heat is still very impressive.

Post reply on HN