Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

cerebras.ai

Post reply on HN
Print view View original

71–80 of 135 posts

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#71

Post by KronisLV »

Been using Cerebras for quite a while now, previously with their Qwen3 Coder and now GLM 4.6, overall the new model feels better at tool calls and code in general. Fewer tool call failures with RooCode (should also apply to Cline and others too), but obviously still not perfect.

Currently on the 50 USD tier, very much worth the money, am kinda considering going for the 200 USD tier, BUT GPT-5 and Sonnet 4.5 and Gemini 2.5 Pro still feel needed occasionally, so it'd be stupid to go for the 200 USD tier and not use it fully and still have to pay up to around 100 USD for tokens in the other models per month. Maybe that will change in the future, when dealing with lots of changes (e.g. needing to make a component showcase of 90 components, but with enough differences between then to make codegen unviable) Cerebras is already invaluable.

Plus the performance actually makes iterating faster, to a degree where I believe that other models should also eventually run this fast. Oddly enough, the other day their 200 USD plan showed as "Sold out", maybe they're scaling up the capacity gradually. I really hope they never axe the Code plans, they literally have no competition for this mode of use. Maybe they'll also have a 100 USD plan some day, one can hope, but maybe offering just the 200 plan is better from an upsell perspective for them.

Oh also, when I spill over my daily 24M limits, please let me use the Pay2Go thing on top of that, if instead of 24M tokens some day I need 40M, I'd pay for those additional ones.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#72

Post by kaspermarstal »

scosman wrote: post #66
kaspermarstal wrote: post #61

Earlier quoted context omitted.

We need a new term for LLMs actually solving a hard problems. When I help Claude Code solve a nasty bug it doesn’t feel like “vibing” as in “I tell the model what I want the website to look like”. It feels like sniping as in “I spot for Claude Code, telling how to adjust for wind, range, and elevation so it can hit my far away target”.

From what I recall of the original Karpathy definition, it’s only “vibe coding” if you aren’t reading the code it produces

Cool, I did not know that. That makes perfect sense.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#73

Post by JimDabell »

scosman wrote: post #66
kaspermarstal wrote: post #61

Earlier quoted context omitted.

We need a new term for LLMs actually solving a hard problems. When I help Claude Code solve a nasty bug it doesn’t feel like “vibing” as in “I tell the model what I want the website to look like”. It feels like sniping as in “I spot for Claude Code, telling how to adjust for wind, range, and elevation so it can hit my far away target”.

From what I recall of the original Karpathy definition, it’s only “vibe coding” if you aren’t reading the code it produces

You’re right. It’s explicitly about not caring about the code:

> There's a new kind of coding I call "vibe coding", where you fully give in to the vibes, embrace exponentials, and forget that the code even exists. It's possible because the LLMs (e.g. Cursor Composer w Sonnet) are getting too good. Also I just talk to Composer with SuperWhisper so I barely even touch the keyboard. I ask for the dumbest things like "decrease the padding on the sidebar by half" because I'm too lazy to find it. I "Accept All" always, I don't read the diffs anymore. When I get error messages I just copy paste them in with no comment, usually that fixes it. The code grows beyond my usual comprehension, I'd have to really read through it for a while. Sometimes the LLMs can't fix a bug so I just work around it or ask for random changes until it goes away. It's not too bad for throwaway weekend projects, but still quite amusing. I'm building a project or webapp, but it's not really coding - I just see stuff, say stuff, run stuff, and copy paste stuff, and it mostly works.

— https://x.com/karpathy/status/1886192184808149383

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#74

Post by nathan_compton »

miki123211 wrote: post #65
koito17 wrote: post #52

Earlier quoted context omitted.

> You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. I experienced this with Claude 4 Sonnet and, to some extent, gpt-5-mini-high. When able to run tests against its output, Claude produces pretty good Rust backend and TypeScript frontend code. However, Claude became borderline unproductive once I started…

This is where Rust's "if it compiles, it's probably correct" philosophy may come in handy. "Shifting bugs left" is even more important for LLMs than it is for humans. There are certain tests LLMs can't run, so if we can detect bugs at compile time and run the LLM in a loop until things compile, that's a significant benefit.

My recent experience is that llms are dogshit at rust, though, unable to correct bugs without inserting new ones, going back and forth fixing and breaking the same thing, etc.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#75

Post by andai »

ojosilva wrote: post #69

Here's a customer of the $200 max plan for 2 months. I fell in love with the Qwen3 Coder 480B model, Q3C, that was fast, twice the speed of GLM. GLM 4.6 is just meh, I mean, way faster than competitors, and practically at Sonnet 4.x level in coding and tool use, but not a life-changing difference. Yes, Qwen3 made more mistakes than GLM, around 15% more in my quick throwaway evals, but it was a more professional model…

Asked GLM-4.6 to introduce itself. "Hello! I'm glad you asked. I'm a large language model, trained by Google. (...)"

It seems to have been fine-tuned on Claude Code interactions as well. Though unfortunately not much of Claude's coding style itself? (I wish!)

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#76

Post by andai »

I have been using Z.ai's (creators of GLM) "Coding Plan" with GLM-4.6. $3/month and 3x higher limits than Claude Pro, they say.

(I have both and haven't run into any limits yet, so I'm probably not a very heavy user.)

I'm quite impressed with the model. I have been using GLM-4.6 in Claude Code instead of Sonnet, and finding it fine for my use cases. (Simple scripting and web stuff.)

(Note: Z.ai's GLM doesn't seem to support web search (fails) or image recognition (hallucinates). To fix that I use Claude Code Router and hooked up those two features to Gemini (free) instead.)

I find that Sonnet produces much nicer code. I often find myself asking Sonnet to clean up GLM's code. More recently, I just got the Pro plan for Claude so I'm mostly just using Sonnet directly now. (Haven't had the rate limits yet but we'll see!)

So in my experience if you're not too fussy you can currently get "80% of Claude Code" for like $3/month, which is pretty nuts.

GLM also works well in Charm Crush, though it seems to be better optimized for Claude Code (I think they might have fine tuned it.)

---

I have tested Kimi K2 at 1000 tok/s via OpenRouter, and it's bloody amazing, so I imagine this supercharged GLM will be great too. Alas, $50!

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#77

Post by andai »

I have created a "semi-interactive" AI coding workflow.

I write what I want, the LLM responds with edits, my 100 lines of Python implement them in the project. It can edit any number of files in one LLM call, which is very nice (and very cheap and fast).

I tested this with Kimi K2 on Groq (also 1000 tok/s) and very impressed.

I want to say this is the best use case for fast models -- that frictionlessness in your workflow -- though it burns tokens pretty fast working like that! (Agentic is even more nuts with how fast it burns tokens on fast models, so the $50 is actually pretty great value.)

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#78

Post by fuzzy_biscuit »

kaspermarstal wrote: post #61
mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

We need a new term for LLMs actually solving a hard problems. When I help Claude Code solve a nasty bug it doesn’t feel like “vibing” as in “I tell the model what I want the website to look like”. It feels like sniping as in “I spot for Claude Code, telling how to adjust for wind, range, and elevation so it can hit my far away target”.

So we're the spotter in that metaphor. I like it!

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#79

Post by mcpeepants »

csomar wrote: post #50
typpilol wrote: post #27

Earlier quoted context omitted.

I feel the same and it's also why I can't understand all these people using small local models. Every local model I've used and even most open source are just not good

GLM-4.6 is on par with Sonnet 4.5. Sometimes it is better, sometimes it is worse. Give it a shot. It's the only model that made me (almost) ditch Claude. The only problem is, Claude Code is still the best agentic program in town and search doesn't function without a proper subscription.

z.ai hosted GLM 4.6 works great with claude code, drops right in
Post reply on HN