Live data from Hacker News

With software alone, one B200 beats the LPU and gets close to Cerebras

runinfra.ai

1–2 of 2 posts

Re: With software alone, one B200 beats the LPU and gets close to Cerebras

#2
Which model wrote this bizarre article?

Lots of emphasis on no kernels written and nothing recompiled but the intro and conclusion somehow suggest this is also the value of runinfra’s agents the rewrite software ?

Walk through the theory of peak decode throughout based on memory bandwidth with one weight load pass per token to provide a target for optimized decide but then doesn’t address low bandwidth utilization in that scenario at all and uses speculative decode where that theory doesn’t apply