Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Groq CEO: 'We No Longer Sell Hardware'

eetimes.com

Post reply on HN
Print view View original

151–152 of 152 posts

Re: Groq CEO: 'We No Longer Sell Hardware'

#151

Post by halflings »

gandalfgeek wrote: post #40
halflings wrote: post #8

Earlier quoted context omitted.

No HBM because they use tons of fast SRAM instead. Isn't that the main driver for performance here? (the way I understood it => it's still cost effective at scale due to throughput increase this brings)

> No HBM because they use tons of fast SRAM instead. Isn't that the main driver for performance here? No doubt fast SRAM helps, but from a computation pov imho its that they've statically planned computation and eliminated all locks. Short explainer here: https://www.youtube.com/watch?v=H77tV1KcWIE (Based on their paper).

Thanks for putting this together! Will give it a watch now

Re: Groq CEO: 'We No Longer Sell Hardware'

#152

Post by anony_moose »

ojn wrote: post #80
LoganDark wrote: post #64

Earlier quoted context omitted.

I'll look into it, though seeing "contact us" always makes me think they're not going to sell a single unit to a home user. (With that said, Groq probably wouldn't either. You can technically buy LPUs for 20k each, without an expectation of support, but it takes tens of them to run Mixtral.) Tenstorrent also looks incredibly Python-specific (as in, everything including their SMI seems mostly Python-based) which doesn…

Most of the low-level pieces are in Rust, the TUI is written in Python and most of the remaining pieces are getting lowered down to the Rust libraries over time. (It was all Python up until ~6 months ago) EDIT: Oh, and you can buy the Grayskull cards online now, without contacting anyone.

I figured I'd add a bit of clarification here. Tenstorrent has a couple SW stacks. The lowest level programming (Metalium) model is written in C++ and goes down to the register level. Higher level entrypoints (ttlib, ttnn) are written on top of that in python. I think it's the smi tooling and other systems software that might be written in rust.
Post reply on HN