Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

cerebras.ai

Post reply on HN
Print view View original

111–120 of 135 posts

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#111

Post by aurareturn »

realo wrote: post #82
divmain wrote: post #22

I have been an AI-coding skeptic for some time. I always acknowledged LLMs as useful for solving specific problems and making certain things possible that weren't possible before. But I've not been surprised to see AI fail to live up to the hype. And I never had a personally magical moment - an experience that shifted my perspective à la the peak end rule. I've been using GLM 4.6 on Cerebras for the last week or so,…

I was AI skeptic too a year ago , but recently i wanted a windows exe program to do the same as a complicated bash script on linux. i gave the bash script to claude code, which immediately started implementing something in the zig language. after a few iterations, i had zig source code that compiled in linux , produced a windows exe and perfectly mimicked the bash script. I know nothing about zig programming.

I've been maintaining my company's Go repos using Claude after our Go developer left. I don't know anything about Go.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#112

Post by andai »

brianjking wrote: post #92
andai wrote: post #85

Earlier quoted context omitted.

Ask and you shall receive! https://docs.z.ai/devpack/tool/claude tldr "env": { "ANTHROPIC_AUTH_TOKEN": "your_zai_api_key", "ANTHROPIC_BASE_URL": "https://api.z.ai/api/anthropic" } Although if you want an Actually Good Experience I recommend using Claude Code Router https://github.com/musistudio/claude-code-router because it allows you to intercept the requests and forward them to other models. (e.g. GLM doesn't seem…

Does this allow me to use Claude Code as the orchestration harness with GLM 4.6 as the LLM along with other LLMs? Seems so based on your description, thanks for the link.

Explain like I'm 5?

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#113

Post by cyanydeez »

mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

Do you think that people will read your flowery prose and suspect you're just part of the dead Internet. We are still waiting for all these AI enhanced apps to flood the market.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#114

Post by demarq »

kaspermarstal wrote: post #61
mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

We need a new term for LLMs actually solving a hard problems. When I help Claude Code solve a nasty bug it doesn’t feel like “vibing” as in “I tell the model what I want the website to look like”. It feels like sniping as in “I spot for Claude Code, telling how to adjust for wind, range, and elevation so it can hit my far away target”.

- backseat engineer

- keyboard princess

- Robin to the Batman

- meatstack engineer

- artificial manager

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#115

Post by killerstorm »

thesz wrote: post #90
killerstorm wrote: post #62

Earlier quoted context omitted.

Well, there are certainly kinds of code LLMs would struggle with, but people generally underestimate what LLMs are capable of. E.g. Victor Taelin is implementing ultra-advanced programming language/runtime writing almost all code using LLM now. Runtime (HVM) is based on Interaction Calculus model which was only an obscure academic curiosity until Taelin started working on it. So a hypothesis that LLMs are only capabl…

I took a look at the Taelin's work [1]. [1] https://github.com/HigherOrderCO/HVM From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted. BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved…

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out.

Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#116

Post by thesz »

killerstorm wrote: post #115
thesz wrote: post #90

Earlier quoted context omitted.

I took a look at the Taelin's work [1]. [1] https://github.com/HigherOrderCO/HVM From my understanding, main problem there is a compilation into (optimal) CUDA code and CUDA runtime, not language or internal representation per se. CUDA is hard to debug, some help can be warranted. BTW, this HVM thing smells strange. The PAPER does not provide any description of experiments where linear parallel speedups were achieved…

Taelin is experimenting with possible applications of interaction calculus. That CUDA thing was one of experiments, and it didn't quite work out. Currently he's working on a different thing: a code synthesis tool. AFAIK he got something better than anything else in this category, but whether it's useful is another question.

  > something better than anything else in this category
That is a strong statement.

[1] https://en.wikipedia.org/wiki/Id_(programming_language)

Id [1] was run on the CM-5 (then) supercomputer and demonstrated superlinear parallel speedups on some of the tasks. That superlinear speedup was due to better cache utilization on individual nodes.

In some of the tasks the amount of parallel execution discovered by Id90 would lead to overflow of content-addressable memory and Id90's runtime implemented throttling to reduce available parallelism to make things to be done at all.

Does the PAPER of HVM refers to Id (Id90 to be precise)? No, it does not.

This is serious negligence of Taelin.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#117

Post by bigyabai »

xadhominemx wrote: post #103
bigyabai wrote: post #7

Earlier quoted context omitted.

For $50/month, it's a non-starter. I hope they can find a way to use all this excess bandwidth to put out a $10 equivalent to Claude Code instead of a 1000 tok/s party trick I can't use properly.

$600 per year is a trivial cost for a professional tool

$600 per anything is Herman Miller territory, pal. I'm not paying that for a SaaS.

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#118

Post by epolanski »

mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

> AI moves so fast that Vibe Coding still has a negative stigma attached to it

As it should, it's about writing code on vibes, not looking at the code, it's literally the definition of the term:

https://x.com/karpathy/status/1886192184808149383

And when I say literally I'm including dictionaries:

https://blog.collinsdictionary.com/language-lovers/collins-w...

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#119

Post by wyre »

bigyabai wrote: post #7
cschneid wrote: post #5

Earlier quoted context omitted.

so apparently they have custom hardware that is basically absolutely gigantic chips - across the scale of a whole wafer at a time. Presumably they keep the entire model right on chip, in effectively L3 cache or whatever. So the memory bandwidth is absurdly fast, allowing very fast inference. It's more expensive to get the same raw compute as a cluster of nvidia chips, but they don't have the same peak throughput. As…

For $50/month, it's a non-starter. I hope they can find a way to use all this excess bandwidth to put out a $10 equivalent to Claude Code instead of a 1000 tok/s party trick I can't use properly.

Cerebras offers pay-per-token. What are you asking for? Claude Code starts at $100, or $15/mtok. Cerebras is already much cheaper, but you want it to be even cheaper at $10?

Re: Cerebras Code now supports GLM 4.6 at 1000 tokens/sec

#120

Post by [deleted] »

dust42 wrote: post #37
mythz wrote: post #28

AI moves so fast that Vibe Coding still has a negative stigma attached to it, but even after 25 years of development, I'm not able to match the productivity of getting AI to implement the features I want. It's basically getting multiple devs to set out and go do work for you where you just tell them what you want and provide iterative feedback till they implement all the features you want, in the way you want and to…

It just depends on what you are doing. A green field react app in typescript with a CRUD API behind? The LLMs are a mind blowing assistant and 1000t/s is crazy. You are doing embedded development or anything else not as mainstream as web dev? LLMs are still useful but no longer mind blowing and often produce hallucinations. You need to read every line of their output. 1000t/s is crazy but no longer always in a good w…

[deleted]
Post reply on HN