Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5.6 Sol Ultra will be in Codex

twitter.com

Post reply on HN
Print view View original

141–150 of 433 posts

Re: GPT-5.6 Sol Ultra will be in Codex

#141

Post by solenoid0937 »

bloppe wrote: post #139
layla5alive wrote: post #26

Earlier quoted context omitted.

https://archive.ph/NEwVz "However, these inference optimizations, which rival Anthropic refers to as “compute multipliers,” are a big focus for all the labs. Anthropic CEO Dario Amodei has been publicly talking about the concept since at least mid-2023, when he said on a podcast that the company limits “the number of people who are aware of a given compute multiplier” because it could give other AI labs a leg up if t…

I agree that Dario is pretty annoying, but I think the "tech villain" archetype is essentially survivorship bias. The tech leaders who don't act that way are not nearly as visible because they're not nearly as successful.

HN is just a massive Anthropic hate fest now, probably funded/manipulated by OAI's $8B PR budget.

OP phrases it as a bad thing that Dario is keeping compute multipliers to Anthropic. How naive can one be? Compute multipliers are the whole business. Those are the trade secrets every lab is built on. It is the alpha of the business. How does protecting this make Dario evil?

This website is getting out of hand with the uninformed hot takes. I wish when HN was still people that knew what they were talking about.

Re: GPT-5.6 Sol Ultra will be in Codex

#142

Post by wahnfrieden »

dools wrote: post #80
ewild wrote: post #53

Earlier quoted context omitted.

people really dont understand how the transformer works to think this is something trivial if possible at all

Orly? “ Automatic Prefix Caching (APC in short) caches the KV cache of existing queries, so that a new query can directly reuse the KV cache if it shares the same prefix with one of the existing queries, allowing the new query to skip the computation of the shared part.” https://docs.vllm.ai/en/latest/features/automatic_prefix_cac...

This thread is about cutting costs in half for GPT across the board.

The technique you linked only makes a substantial difference for particular use cases where you are going to have many LONG CONTEXT queries with the same prefix. For instance, when having a set of documents that commonly get loaded in as context. It's a way for application developers to keep prefixes they manage (or prefixes managed by some set of their users) cached. It has no relevance for long tail general purpose use.

Re: GPT-5.6 Sol Ultra will be in Codex

#143

Post by bloppe »

adahn wrote: post #102
nmfisher wrote: post #65

Earlier quoted context omitted.

> If you look at everything through their safe AGI mission it all makes sense. Except for, you know, all the outside investors and the forthcoming IPO.

A no-investment policy would take them off the scene entirely. Essentially handing over the reins to OpenAI, Google, and others. Their position is something close to "if I don't do it, someone worse will". Related: https://80000hours.org/2012/03/the-replaceability-effect-wor... There's a more nuanced discussion that could be had about how to balance relevance with outside influence. But at a foundational level it sho…

"if I don't do it, someone worse will"

Of course that's what Dario thinks because that's what every tech CEO thinks. Dario, Sam, Sundar, probably many Chinese CEOs as well. It's what everyone thinks. That's why they're competing so fiercely with one another. That's why they basically make all the same decisions. That's why we need properly open source AI.

Re: GPT-5.6 Sol Ultra will be in Codex

#144

Post by solenoid0937 »

nmfisher wrote: post #65
llelouch wrote: post #56

Earlier quoted context omitted.

Dario tells the truth. If you look at everything through their safe AGI mission it all makes sense. They are not bs'ing about that. Also I think most people just read headlines or 10 second clips and make false extrapolations from there. (BTW Anthropic only exists because Sam Altman is a liar, Dario admitted this.)

> If you look at everything through their safe AGI mission it all makes sense. Except for, you know, all the outside investors and the forthcoming IPO.

You expect AGI to be built without additional investor money?

Re: GPT-5.6 Sol Ultra will be in Codex

#145

Post by bloppe »

solenoid0937 wrote: post #141
bloppe wrote: post #139

Earlier quoted context omitted.

I agree that Dario is pretty annoying, but I think the "tech villain" archetype is essentially survivorship bias. The tech leaders who don't act that way are not nearly as visible because they're not nearly as successful.

HN is just a massive Anthropic hate fest now, probably funded/manipulated by OAI's $8B PR budget. OP phrases it as a bad thing that Dario is keeping compute multipliers to Anthropic. How naive can one be? Compute multipliers are the whole business. Those are the trade secrets every lab is built on. It is the alpha of the business. How does protecting this make Dario evil? This website is getting out of hand with the…

I'm saying I would do the same thing if I were Dario. I don't think he's evil. I just think his hero complex is annoying.

Re: GPT-5.6 Sol Ultra will be in Codex

#146

Post by bberrry »

dprkh wrote: post #116
throw394042 wrote: post #30

I'm working in large US corporation. And I see that I already have access to 5.6-Sol Ultra on my corporate account. I haven't really used it yet. 2 months ago management was showing us scoreboards, praising leaders who used most tokens. Last few weeks, we're getting weekly emails, telling us that whenever we can - we should use cheaper models, and that we should watch the page which shows our tokens usage.

Are corporate employees not allowed to use personal subscriptions?

If you want your company's code to be used in training, then yes.

Re: GPT-5.6 Sol Ultra will be in Codex

#148

Post by solenoid0937 »

bloppe wrote: post #143
adahn wrote: post #102

Earlier quoted context omitted.

A no-investment policy would take them off the scene entirely. Essentially handing over the reins to OpenAI, Google, and others. Their position is something close to "if I don't do it, someone worse will". Related: https://80000hours.org/2012/03/the-replaceability-effect-wor... There's a more nuanced discussion that could be had about how to balance relevance with outside influence. But at a foundational level it sho…

"if I don't do it, someone worse will" Of course that's what Dario thinks because that's what every tech CEO thinks. Dario, Sam, Sundar, probably many Chinese CEOs as well. It's what everyone thinks. That's why they're competing so fiercely with one another. That's why they basically make all the same decisions. That's why we need properly open source AI.

Open source AI fails first contact with sufficiently-intelligent-as-to-be-dangerous AI.

The day Mythos class models are open sourced will not be a good day. I don't think you understand the impact that will have on the world and on cyber defenders everywhere. It will be pure chaos.

Even if you don't think Mythos-class is the bar, open source has to stop at some point, you don't hand everyone a superweapon.

Re: GPT-5.6 Sol Ultra will be in Codex

#149

Post by throwaway27448 »

chkmr wrote: post #135
throwaway27448 wrote: post #127

Bruh when did understanding chatbots become like following pokemon? Wtf does any of this this mean. Tf is sol? Tf is ultra? Tf is codex? Tf happened to descriptive nomenclature?

Maybe you jest, but I'll bite. > Tf is sol? It's a proper noun: the name given to their latest and greatest model. Means "Sun" in Latin. Similar to how Anthropic has been naming its models Fable, Opus, Sonnet etc. Their other models are called Terra (Latin: Earth) and Luna (Latin: Moon) [0]. > Tf is ultra? The name of the "harness" around the model. It'll use deeper thinking, subagents and all that jazz in response t…

Of course I understand all this, but why the cuteness? Why not just say " 2 agent?

> Something like GLM-4-32B-0414-128K (not made up [2]) doesn't quite roll off the tongue I suppose.

Surely it would sell better though if they could communicate what they're selling?

> Coding agent" similar to Claude Code [1], something with a more descriptive name.

Does this really need branding at all? Surely claude should sell itself if it can work as an agent. And if it is a specific model, what tasks is it trained to do? can we see the fucking training to make this money worth it? Or am I just another sucker buying nikes?

All of this hand waving makes me nauseated. People should buy value, not vibes.

Re: GPT-5.6 Sol Ultra will be in Codex

#150

Post by imhoguy »

xcjsam wrote: post #66

Will it have similar limited access like Fable? It is an interesting timeline, as general access for Fable (without using extra credits) is coming to an end :(

It is like with drug dealers, you get some free dose, then cheap one, then you pay an arm and a leg.

Somebody has to finaly pay for these heaps of accelerator hardware.

Post reply on HN