Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

cerebras.ai

Post reply on HN
Print view View original

41–50 of 135 posts

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#41

Post by whiterook6 »

almostgotcaught wrote: post #40
dust42 wrote: post #37

Earlier quoted context omitted.

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

I've said it before but no one takes it seriously: LLMs are only useful if you're building something that's already in the training set ie already commodity . In which case why are you building it ???

It's not that the product you're building is a commodity. It's that the tools you're using to built it are. Why not build a landing page using HTML and CSS and tailwind? Why not use swift to make an app? Why not write an AWS lambda using JavaScript?

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#42

Post by mythz »

almostgotcaught wrote: post #40
dust42 wrote: post #37

Earlier quoted context omitted.

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

I've said it before but no one takes it seriously: LLMs are only useful if you're building something that's already in the training set ie already commodity . In which case why are you building it ???

"LLMs are only useful..."

Is likely why no one takes you seriously, as it's a good indication you don't have much experience with them.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#44

Post by [deleted] »

gardnr wrote: post #31
odie5533 wrote: post #29

I find the fast models good for rapidly iterating UI changes with voice chat. Like "add some padding above the text box" or "right align the button". But I find the fast models useless for deep coding work. But a fast model has its place. Not $50/month though. Cursor has Compose 1 and Grok Code Fast for free. Not sure what $50/month gets me that those don't. I liked the stealth supernova model a lot too.

GLM 4.6 isn't a "fast" model. It does well in benchmarks vs Sonnet 4.5. Cerebras makes a giant chip that runs inference at unreal speeds. I suspect they run their cloud service more as an advertising mechanism for their core business: hardware. You can hear the founder describing their journey: https://podcasts.apple.com/us/podcast/launching-the-fastest-...

[deleted]

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#45

Post by lifthrasiir »

dust42 wrote: post #37
mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

There aren't many things that LLMs haven't really seen yet, however. I have successfully used LLMs to develop a large portion of WebAssembly 3.0 interpreter [1], which surely aren't in their training set because WebAssembly 3.0 was only released months ago. Sure, it took me tons of guidance but it was useful enough for me.

Even llama.cpp is not a truly novel thing to LLMs, there are several performant machine learning model executors available in their training sets anyway, and I'm sure llama.cpp can benefit from LLMs if they want; they just chose not to.

[1] https://github.com/lifthrasiir/wah/

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#46

Post by prodigycorp »

NitpickLawyer wrote: post #36
prodigycorp wrote: post #11

Earlier quoted context omitted.

Can you provide more context for this? (eg Was SWE-1.5 released recently? Is it considered good? Is it considered fast? Was there speculation about what the underlying model was? How does this prove that it's a GLM finetune?)

People saw chinese characters in generations made by swe-1.5 (windsurfs model) and also in the one made by cursor. This led to suspicions that the models are finetunes of chinese models (which makes sense, as there aren't many us/eu strong coding models out there). GLM4.5/4.6 are the "strongest" coding models atm (with dsv3.2 and qwen somewhat behind) so that's where the speculation came from. Cerebras serving them a…

Really appreciate this context. Thank you!

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#47

Post by dust42 »

1000 tokens/s is pretty fancy. I just wonder how sustainable the pricing is or if they are VC-fueled drug dealers trying to convert us into AI-coholics...

It is definitely fun playing with these models at these speeds. The question is just how far from real pricing is 500M tokens for $50?

Either way the LLM usage will grow for some time to come and so will grow energy usage. Good times for renewables and probably fusion and fission.

Selling shovels in a gold rush was always reliable business. Cerebras is only rated at $8.1B as of one month ago. Compared to Nvidia that seems pocket change.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#48

Post by nurettin »

almostgotcaught wrote: post #40
dust42 wrote: post #37

Earlier quoted context omitted.

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

I've said it before but no one takes it seriously: LLMs are only useful if you're building something that's already in the training set ie already commodity . In which case why are you building it ???

Do you avoid writing anything that the programming community has ever built? How are you alive???

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#49

Post by antonvs »

almostgotcaught wrote: post #40
dust42 wrote: post #37

Earlier quoted context omitted.

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

I've said it before but no one takes it seriously: LLMs are only useful if you're building something that's already in the training set ie already commodity . In which case why are you building it ???

The obvious point that you're missing is that there are literally infinite ways to assemble software systems from the pieces that an LLM is able to manipulate due to its training. With minor guidance, LLMs can put together an unlimited number of novel combinations. The idea that the entire end product has to be in the training set is trivially false.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#50

Post by csomar »

typpilol wrote: post #27
bigyabai wrote: post #7

Earlier quoted context omitted.

For $50/month, it's a non-starter. I hope they can find a way to use all this excess bandwidth to put out a $10 equivalent to Claude Code instead of a 1000 tok/s party trick I can't use properly.

I feel the same and it's also why I can't understand all these people using small local models. Every local model I've used and even most open source are just not good

GLM-4.6 is on par with Sonnet 4.5. Sometimes it is better, sometimes it is worse. Give it a shot. It's the only model that made me (almost) ditch Claude. The only problem is, Claude Code is still the best agentic program in town and search doesn't function without a proper subscription.
Post reply on HN