Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Accelerating GPT-5.6 Sol Ultrafast

cerebras.ai

Post reply on HN
Print view View original

141–150 of 295 posts

Re: Accelerating GPT-5.6 Sol Ultrafast

#141

Post by xyzsparetimexyz »

modeless wrote: post #107
xyzsparetimexyz wrote: post #78

Earlier quoted context omitted.

Yes. but for embarrassingly parallel tasks it barely matters.

The task the majority of people here care about (and which makes up a huge part of AI lab revenue these days) is collaborative coding with a single human which is not embarrassingly parallel.

I am aware. I was talking about HLE. Talking about how fast you can run through HLE in a serial manner is like talking about how how fast your non-simd single threaded cpu ray tracer is. Its simply not how any sensible person would tackle this problem.

Re: Accelerating GPT-5.6 Sol Ultrafast

#142

Post by ChadMoran »

minraws wrote: post #135
aetherspawn wrote: post #130

Earlier quoted context omitted.

I discovered yesterday that the “amazing thing that comes out of OpenAI” is Sol, due to its token efficiency. Dollar for tokens, Sol and Fable are the same price. However, Sol uses (literally: in testing) around 10-100x less output tokens compared to Fable for the same task. We run our frontier models nearly 24/7, so switching to Sol will save us around $500 per day. And, due to less guardrails, Sol also performed be…

Wait isn't Fable like 2x more expensive if we compare under 272k tokens

The comment you're replying to almost feels like it was written by a bot or am I crazy?

Re: Accelerating GPT-5.6 Sol Ultrafast

#143

Post by w4yai »

ChadMoran wrote: post #142
minraws wrote: post #135

Earlier quoted context omitted.

Wait isn't Fable like 2x more expensive if we compare under 272k tokens

The comment you're replying to almost feels like it was written by a bot or am I crazy?

I agree. Weird to use and characters. Maybe written on phone, but certainly not on keyboard.

Re: Accelerating GPT-5.6 Sol Ultrafast

#144

Post by headPoet »

dzhiurgis wrote: post #112
tomrod wrote: post #77

Earlier quoted context omitted.

ChatJimmy is a much smaller model and, AFAIK, has no reasoning capability. Absolutely insane raw speed, like a supercar, while Sol is more like a freight truck.

The knowledge of ChatJimmy is terrible. Even Qwen on my iPhone is better.

ChatJimmy isn't a model, it's Llama 3.1 8B hardwired into silicon. The point isn't to be a good llm, but to showcase the speedup that's possible

Re: Accelerating GPT-5.6 Sol Ultrafast

#145

Post by jlund-molfese »

ChadMoran wrote: post #142
minraws wrote: post #135

Earlier quoted context omitted.

Wait isn't Fable like 2x more expensive if we compare under 272k tokens

The comment you're replying to almost feels like it was written by a bot or am I crazy?

What kind of bot would say `less guardrails` instead of `fewer guardrails`? I guess someone could instruct an LLM to deliberately make mistakes, but isn't that too paranoid?

Re: Accelerating GPT-5.6 Sol Ultrafast

#146

Post by resonious »

aetherspawn wrote: post #130
iamcoder18 wrote: post #13

I've been waiting so long for something amazing to come out of the OpenAI and Cerebras collaboration. > In our evaluations, GPT-5.6 Sol on Ultrafast mode answered all 2,500 HLE questions in 11 hours and 11 minutes. Claude Fable 5 needed 78 hours and 27 minutes, more than three days of continuous compute, to arrive at the same conclusions. In other words, Ultrafast worked through the frontier of human knowledge in a s…

I discovered yesterday that the “amazing thing that comes out of OpenAI” is Sol, due to its token efficiency. Dollar for tokens, Sol and Fable are the same price. However, Sol uses (literally: in testing) around 10-100x less output tokens compared to Fable for the same task. We run our frontier models nearly 24/7, so switching to Sol will save us around $500 per day. And, due to less guardrails, Sol also performed be…

Sol is way cheaper than Fable by the token.

Re: Accelerating GPT-5.6 Sol Ultrafast

#148

Post by huey77 »

I think token output speed is going to be one of the biggest fundamental shifts for AI this year. In my experience, models figure out problems after enough turns (or in agent swarms if its a lower tier model). Compressing that time horizon could take days of agentic coding into minutes. How ever will my monkey brain keep up?

Re: Accelerating GPT-5.6 Sol Ultrafast

#149

Post by gunalx »

w4yai wrote: post #143
ChadMoran wrote: post #142

Earlier quoted context omitted.

The comment you're replying to almost feels like it was written by a bot or am I crazy?

I agree. Weird to use and characters. Maybe written on phone, but certainly not on keyboard.

Common on non us keebs though.

Re: Accelerating GPT-5.6 Sol Ultrafast

#150

Post by phoghed »

andai wrote: post #120
iamcoder18 wrote: post #13

I've been waiting so long for something amazing to come out of the OpenAI and Cerebras collaboration. > In our evaluations, GPT-5.6 Sol on Ultrafast mode answered all 2,500 HLE questions in 11 hours and 11 minutes. Claude Fable 5 needed 78 hours and 27 minutes, more than three days of continuous compute, to arrive at the same conclusions. In other words, Ultrafast worked through the frontier of human knowledge in a s…

I'm finding Luna suprisingly adequate for my work. I slept on it due to the benchmarks, but it's very fast and even on low reasoning I'm finding it more than adequate for "menial" work. (The speed is crucial for "interactive" work -- if a model is fast enough it goes from "async" to "real time", subjectively, which is a huge difference.) In fact, I'd say it's overqualified for the kind of work I'm doing, because it s…

Luna has impressive results on DeepSWE.

I mostly split work between Luna and Sol. If something seems simple enough I always try it with Luna first.

Post reply on HN