GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
1–10 of 31 posts
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#2I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#3I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
I was doing a demo to my colleagues and had the above.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#4I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
Same with groq.com, there is a "try this", and after you enter the prompt, it asks you to sign in. Closed the page.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#5It’s an absolute beast. I run it via OpenRouter, where I have Groq and Cerebras as the providers. Cheap enough as to be almost free, strong performance, and lightning fast.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#6The Cerebras GML-4.6 post might also be of (some?/more?) interest to the people here, since it's more useful for programming: https://news.ycombinator.com/item?id=45852751
I don't think that this is a dupe or anything and 3000 t/s is really cool, the other post just has more discussion of Cerebras and people's experiences with using GLM 4.6 for software development.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#7I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
Headline at the top of the Cerebras page linked to by the OP "Cerebras Raises $1.1B Series G at $8.1B Valuation".
If you're going after the AI money gravy train then you need to wave the "we have $n registered users" carrot on your PPT slides for the investors because registered user == monetization opportunity.
I'm not defending it. I hate being forced to register for shit when I just want to try it or use the free tier.
But it is what it is.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#8It’s an absolute beast. I run it via OpenRouter, where I have Groq and Cerebras as the providers. Cheap enough as to be almost free, strong performance, and lightning fast.
Cheap enough for now, but of all the companies selling inference at a loss, Cerebras and Groq are probably losing the most per token. Their hardware is ungodly expensive and its reliance on huge amounts of SRAM bottlenecks how much cheaper it can get, since SRAM density is improving at a snails pace at this point.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#9I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
This is like declaring that a Ferrari dealership offering you a free test drive in a million dollar art exhibit on wheels is evil for asking for your phone number before handing you the keys.
If this was some beat-to-hell, high-mileage used economy car, sure, that would be a pain in the ass, and not worth it. But it's a mistake to place Cerebras into that mental bucket.
You don't even need to use real information to create an account. Just grab a temp-mail disposable address and sign up as fred flintstone or mickey mouse.
If you're a heavy LLM inference user (i.e. if you've ever paid for a $200/mo sub from any of the big AI labs), I can damn near guarantee you will not regret trying out Cerebras.
Re: GPT-OSS 120B Runs at 3000 tokens/sec on Cerebras
#10I absolutely hate it, when a website says "try this" and after you went through the trouble of weiting something comes up with a sign up link first. Makes me leave instantly to never come back.
Headline at the top of the Cerebras page linked to by the OP "Cerebras Raises $1.1B Series G at $8.1B Valuation" . If you're going after the AI money gravy train then you need to wave the "we have $n registered users" carrot on your PPT slides for the investors because registered user == monetization opportunity . I'm not defending it. I hate being forced to register for shit when I just want to try it or use the fre…
Well if they give it out for free (aka they pay for it), asking you to register is a reasonable ask. It's not a public service funded by taxpayers.