Earlier quoted context omitted.
I think the wafer itself isn’t the whole deal. If you watch their videos and read the link you posted the wafer size allows them to stack them in a block with integrated power and cooling at a higher density than blades and attach enormous amounts of memory. Not including the system, cooling, cluster, etc seems like a relatively unfair comparison too given the node includes all of those things - which are very expens…
Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_waf...
AI chipmaker Cerebras files for IPO
51–60 of 138 posts
Re: AI chipmaker Cerebras files for IPO
#52Earlier quoted context omitted.
I think the wafer itself isn’t the whole deal. If you watch their videos and read the link you posted the wafer size allows them to stack them in a block with integrated power and cooling at a higher density than blades and attach enormous amounts of memory. Not including the system, cooling, cluster, etc seems like a relatively unfair comparison too given the node includes all of those things - which are very expens…
Can their system attach memory? from what I read, it doesn't seem to be able to: https://www.reddit.com/r/mlscaling/comments/1csquky/with_waf...
Re: AI chipmaker Cerebras files for IPO
#53Cerebras is well-known in the AI chip market. They make chips that are an entire wafer. https://spectrum.ieee.org/cerebras-chip-cs3
Yep! Them, SambaNova, and Groq are super exciting mid-late stage startups imo.
And especially don't tell them to start looking into who "sovereign clouds" actually are!
Re: AI chipmaker Cerebras files for IPO
#54Earlier quoted context omitted.
Saying it's "just" a lot of engineering effort to catch up isn't wrong, but it understates the reality. There are very few organizations on earth that have the technical and financial resources to meaningfully compete with even small parts of Nvidia's portfolio. Nvidia's products benefit from that breadth of strengths and the volumes they ship. They don't just make accelerators, they'll sell you the hardware too (unl…
People said the same about Cisco, Intel, IBM etc. It will only be a matter of time for companies to eat into the high margin stuff for specific use-cases and grow from there.
Re: AI chipmaker Cerebras files for IPO
#55NVIDIA is pretty established but there's also Intel, AMD, Google to contend with. Sure Cerebras is unique in that they make one large chip out of the entire wafer but nothing prevents these other companies from doing the same thing. Currently they are choosing not to because of wafer economics but if they chose to, Cerebras would pretty much lose their advantage. https://www.servethehome.com/cerebras-wse-3-ai-chip-la…
What are they?
Is this related to defects? Can't they disable parts of defective chip just like other CPUs do? Sounds cheaper than cutting up and packaging chips individually!
Re: AI chipmaker Cerebras files for IPO
#56Re: AI chipmaker Cerebras files for IPO
#57Cerebras is well-known in the AI chip market. They make chips that are an entire wafer. https://spectrum.ieee.org/cerebras-chip-cs3
Cerebrus made a great (now deleted) video on the whole computer hosting the wafer: https://web.archive.org/web/20230812020202/https://www.youtu... It’s fascinating.
Wow 200k amps in a chip. Whole thing looks like an early computer from 50s.
Re: AI chipmaker Cerebras files for IPO
#58Re: AI chipmaker Cerebras files for IPO
#59Wafer scale integration has been a thing since wafers. Yet, I almost never read of anyone taking it the full distance to a product. I don't know if it turns out the yield per die per wafer or the associated technology problems were the glitch, but it feels like a good idea which never quite makes it out the door.