Qwen 3.8 27B available on Cerebras at 1500 tokens/s • Hacker News Board

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#41

Post by [deleted] » Thu, Sep 03, 2026, 7:16 PM UTC

jasongill wrote: post #9

gardnr wrote: post #2

I used their Coding Plan for a few months. It is genuinely difficult to keep up with the models. The output is so fast. Qwen 3.8 27B is likely one of the strongest models they've hosted so far. Edit: it looks like this is only available on a API token pricing. Does anyone know if they have rolled out prompt caching yet? It used to get pretty expensive for agentic coding tasks with no prompt caching.

It appears that they do support Prompt Caching: https://inference-docs.cerebras.ai/capabilities/prompt-cachi...

[deleted]

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#42

Post by qiine » Thu, Sep 03, 2026, 7:17 PM UTC

miohtama wrote: post #30

byako wrote: post #18

[flagged]

Your brain can wash laundry and cook pasta, so there is still a long way to go

(requires additional fleshy bits sold separately)

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#43

Post by Barbing » Thu, Sep 03, 2026, 7:17 PM UTC

abtinf wrote: post #35

jasongill wrote: post #9

Earlier quoted context omitted.

It appears that they do support Prompt Caching: https://inference-docs.cerebras.ai/capabilities/prompt-cachi...

> How are cached tokens priced? > There is no additional fee for using prompt caching. Input tokens, whether served from the cache or processed fresh, are billed at the standard input token rate for the respective model. Well, talk about flipping the narrative.

heh

Is there a speed increase or is that purely marketing spin on “we might cache on our end but no discount for you”?

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#44

Post by yipinwong » Thu, Sep 03, 2026, 7:18 PM UTC

vb-8448 wrote: post #23

At that speed it's too pricey for agentinc tasks.

The target audience is who needs raw speed.

Having the choice is good as you can make a trade-off between speed, perf, and quality.

Until last year, people had a single AI god they believed in (mostly Anthropic stuff). Now we have power to make choices (open-weights, SOTA, speed-optimized, etc) the same way you do for system designs.

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#45

Post by dgellow » Thu, Sep 03, 2026, 7:19 PM UTC

byako wrote: post #18

[flagged]

Your brain updates itself constantly and maintains your whole body, LLMs are static.

Still, 1500tokens/s is indeed wild

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#46

Post by gardnr » Thu, Sep 03, 2026, 7:20 PM UTC

singpolyma3 wrote: post #28

gardnr wrote: post #2

I used their Coding Plan for a few months. It is genuinely difficult to keep up with the models. The output is so fast. Qwen 3.8 27B is likely one of the strongest models they've hosted so far. Edit: it looks like this is only available on a API token pricing. Does anyone know if they have rolled out prompt caching yet? It used to get pretty expensive for agentic coding tasks with no prompt caching.

The coding plan is gone now right?

Last time I got one, I had to log into a Discord server and wait for "the drop" and IIRC Daniel Kim was giving them out based on who was there at the time. They were gone in less than a minute. This was ~8 months ago.

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#47

Post by [deleted] » Thu, Sep 03, 2026, 7:20 PM UTC

zackangelo wrote: post #31

jasongill wrote: post #16

It would be great if they made their inference capacity for this model available via OpenRouter; the fastest provider on OpenRouter right now is at ~80tps https://openrouter.ai/qwen/qwen3.8-27b#providers They do appear to host other models on OpenRouter so maybe Qwen3.8 will be there soon: https://openrouter.ai/provider/cerebras

We're serving it around 150-200tok/s (uses our new speculative decoding implementation on a DFlash2 draft model). https://mixlayer.com , LAUNCH-Q38-27B gets you $5 in credits if you want to kick the tires.

[deleted]

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#48

Post by pllbnk » Thu, Sep 03, 2026, 7:21 PM UTC

Just a couple days ago I learned about ninfer (https://github.com/Neroued/ninfer) and on RTX 5090 I can now get ~200 tok/s and over 400 tok/s on concurrent requests which is plenty fast for a local model of this strength.

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#49

Post by howunfortunate » Thu, Sep 03, 2026, 7:22 PM UTC

eli wrote: post #29

byako wrote: post #18

[flagged]

If you read the reasoning trace for Qwen 3.8, it does a whole lot of "uh" and "But, wait..." too

You're absolutely right - filler words are genuinely load-bearing

Re: Qwen 3.8 27B available on Cerebras at 1500 tokens/s

#50

Post by hexa00 » Thu, Sep 03, 2026, 7:23 PM UTC

Just tried it on a medium size coding/debug problem on an existing codebase, observations: - Input doesn't look faster than other models, it spends a lot of time reading Read about 5M tokens - Output is awesome, super fast as you expect from the 1500t/sec I think that's correct - Tool call is failing more than say DS4, which leads to time wasted on retries (complex tools like browser control for example) - Shell commands are still somewhat of a bottleneck

The net effect is that I spend about the same time waiting, and I still need to read that output so, at least for coding, it actually reconciles me with the 100-200t/sec you can get on DS4 or the like. Maybe that's a good sweet spot after all and faster t/sec is not where the bottleneck is.

Also maybe my setup (OMP) doesn't do the cache correctly but that's a huge cost driver... so atm it's quite pricy