Earlier quoted context omitted.
at 15K tokens/s... do you need code anymore
Yeah, that's the point, right? With tool calling the LLM becomes code. So instead of asking it to write an accounting software, you can hire the LLM to be your accountant.
Previewing GPT‑5.6 Sol: a next-generation model
551–560 of 797 posts
Re: Previewing GPT‑5.6 Sol: a next-generation model
#552Re: Previewing GPT‑5.6 Sol: a next-generation model
#553I hate not being able to use the latest models. There needs to be a much faster resolution to whatever is happening with the federal government.
lol. It's about national security and the worry is real, even if the administration is a dangerous clown show.
Re: Previewing GPT‑5.6 Sol: a next-generation model
#554> We're also launching GPT‑5.6 Sol on Cerebras at up to 750 tokens per second in July, bringing frontier intelligence to customers at unprecedented speed. This is really exciting. I work on voice AI, and we're still using 4.1/4.1 mini since none of the frontier models come close on latency. I'm excited to be able to have more interactive experiences, I think it'll unlock new ways of working with these models.
GPT 5.5 with no reasoning is actually slightly faster, and much smarter, but too expensive.
What I'm really looking forward to are the next gen speech to speech models. gpt-realtime-2 is almost there, but not quite good enough for our use case. 5.4 actually beats it on answer latency even cascaded with stt/tts.
Re: Previewing GPT‑5.6 Sol: a next-generation model
#555Previewing : a next-generation model
Re: Previewing GPT‑5.6 Sol: a next-generation model
#556Here is a trend I'm noticing: - GPT-5 mini costs $0.25/$2 and will be discontinued in December. - GPT-5.4 mini costs $0.75/$4.5 and is supposed to be the replacement. - GPT-5.4 nano costs $0.2/$1.25 and, while it ranks better in benchmarks than GPT-5 mini, it's not even close when you test it in real scenarios. So you're left being forced to go to GPT 5.4 mini if you use 5 mini today. The same thing is happening here…
Re: Previewing GPT‑5.6 Sol: a next-generation model
#557Easily the most interesting part of this announcement is buried in the second to last paragraph: "We're also launching GPT‑5.6 Sol on Cerebras at up to 750 tokens per second in July, bringing frontier intelligence to customers at unprecedented speed. Access will initially be limited to select customers as we expand capacity." 750 tokens/s on a frontier model is going to be extremely interesting. I doubt this new vers…
Re: Previewing GPT‑5.6 Sol: a next-generation model
#558Earlier quoted context omitted.
What is your definition of AGI that the current LLMs don't fit?
AGI should be able to do every job a human can do using a computer at least as well as the average human.
Re: Previewing GPT‑5.6 Sol: a next-generation model
#559Earlier quoted context omitted.
What is your definition of AGI that the current LLMs don't fit?
You’d have to really stretch the definition of AGI to make the current models fit
There's a reason why ai xrisk doomers had to come up with the term ASI.
I would seriously suggest that everyone take a look at the wikipedia page for AGI from the month before ChatGPT was released, compare it to the current version, and not come to that conclusion.
https://en.wikipedia.org/w/index.php?title=Artificial_genera...
Re: Previewing GPT‑5.6 Sol: a next-generation model
#560Earlier quoted context omitted.
What is your definition of AGI that the current LLMs don't fit?
AGI should be able to do every job a human can do using a computer at least as well as the average human.